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SUMMARY 



This research was concerned with assessing the effects of college 
environments upon student attitudes toward pursuing advanced graduate or 
professional study» Subjects were selected from college directories at 
50 colleges and universities, and approximately 1,200 panel members in 
the entering college class of 1963 provided survey responses at the com- 
pletion of their sophomore, junior, and senior years of undergraduate 
study„ A standard set of 23 scales, administered on. each occasion, was 
used to assess the characteristics of faculty members and students e 
respondents knew best during the preceding year„ The procedures pro- ^ 
vided the means of studying (a) the effects upon perceived college envi- 
ronments and upon student aspirations and values of entering a major 
field of study, (b) the degree to which the aspirations and values ot 
students changed concomitantly with the perceived values and expectations 
of teachers and peers, and (c) the effects of college environments and 
experiences upon decisions to seek advanced training. In addition, the 
data were useful in evaluating alternative methods of analyzing the 
impacts of college environments upon students. 

The most striking effects of entering a major field of study were 
upon the kinds of teacher and peer subcultures respondents _ 

experienced. The results confirm in part the development of ^o cultures 
scientific and humanistic— which many observers have described. Students in 
these two cultures not only described the teachers they knew best in marke y 
different terms; they also described their close undergraduate friends very 
differently. Entry into the physical sciences produced increases in taculty 
and student press for science and for advanced training, while entry into 
the humanities produced increases in faculty press for humanities and in 
student press for estheticism. There was no evidence that entering a field 
of study had effects upon aspirations to seek advanced training, but entry 
into some major fields of study produced effects upon the student s values, 
particularly upon his prosocial, affluence, intellectual, and individualistic 

values. 

During the last two years of college, panel members exhibited marked^ 
increments in degree aspirations, and also exhibited concomitant changes in 
faculty and student press and in student values. At the completion o e 
sophomore year, 63 per cent of the women and 82 per cent of the men planned 
at least some graduate study, while at the completion of the senior year ^ 
per cent of the women and 92 per cent of the men reported such plans. During 
the same period, student descriptions of their college environments indicated 
that there were large increments in faculty affiliation, supportiveness, 
regard for the respondent's ability, and press for advanced training and 
independent thinking. There were parallel increases in reported student 
press for advanced training, and in the percentage of panel members reporting 
that their close friends planned to pursue graduate study. On the average, 
both men and women exhibited increases in individualistic, and decreases in 
prosocial, value orientations. Most of the results are congruent with the 
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hypothesis that teachers and peers provide modeling stimuli, which persuade 
many undergraduates that advanced graduate or professional training is an 
appropriate goal. 

Although 9 out of every 10 of the panel members said at the completion 
of college that they planned to do at least some graduate study, only 28 
per cent of the women and 57 per cent of the men entered graduate or pro- 
fessional school immediately. Hypotheses concerning the impacts of college 
upon decisions to pursue graduate study were evaluated by partial correla- 
tions which held constant initial dispositions to seek advanced training. 
These tests confirmed the hypotheses that desire to pursue graduate study 
was strengthened by (a) achieving good rapport with college teachers during 
the senior year, (b) exposure to peers exerting press for advanced training, 
(c) talking with faculty members, students, and parents about plans for 
graduate study, (d) winning recognition for academic achievement in college, 
and (e) undergraduate research participation. 

The research suggests the following conclusions concerning different 
methodologies for studying the impacts of college upon students. First, 
in analyzing data from quasi— experiments a method of analysis which controls 
errors of measurement of initial status is highly desirable. In most cases, 
the method of first choice entails estimates of the reliabilities of pretest 
measures, and analysis of covariance using estimated true scores on the pre- 
test as the covariate. Second, while conventional covariance analysis meth- 
ods generally yield inflated significance levels in assessing treatment 
effects, these methods are generally superior to two other criteria that 
have been proposed for assessing such effects (increment in treatment- 
outcome correlation and increment in pooled variance). Third, it is shown 
that it is possible to define conditions under which measurement errors on 
a covariable can be ruled out as an explanation for observed differences 
between adjusted means yielded by conventional covariance analysis. Finally, 
it was shown that partial correlation techniques for assessing causal effects 
are more robust than has generally been supposed. Overall, this research 
provided a basis for optimism that the classical measurement problems associ- 
ated with the research literature on the impacts of colleges upon students 
may not be insoluble. 
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CHAPTER I 



INTRODUCTION 

The purpose of this project was to identify types of faculty and 
peer subcultures which facilitate or impede development of motivation 
to seek advanced graduate or professional study. Reviews of the liter- 
ature related to this topic have recently been presented by Newcomb and 
Feldman (33) and by This tie thwaite (52 )s and a brief sketch of the most 
salient features of this literature will suffice for the purpose of 
introducing the major topics to be considered. More extensive discussions 
of the most relevant studies are found in the chapters which follow. 



Related Studies 

Research aimed at identifying college environments which are un- 
usually effective in stimulating the achievement motivation of under- 
graduates dates from about 1930 when the early studies by Prentice and 
Kunkel (37538) appeared. These studies were the first examples of a mode 
of analysis which has subsequently come to be called a "college produc- 
tivity" analysis. In this mode of analysis undergraduate colleges and 
universities are regarded as the population to be sampled, and an attempt 
is made to describe the characteristics of institutions which are unusually 
"high" or "low" with respect to their output of students (graduates) who 
later obtain advanced degrees or other types of scholarly recognition. 
Perhaps the best-known study in this tradition is that by Knapp and 
Goodrich (25) in which colleges were compared with respect to their out- 
puts of alumni who later earned the Ph.D. degree. Other investigators 
who have reported studies conforming to this paradigm include: Astin 

( 2, 3, 7), Astin and Panos (8 ), Kunkel (27), Kunkel and Prentice (28), 
Nichols (34), Skager, Holland, and Braskamp (4l), Thistle thwaite (45,46), 
Traxler (54), and Visher (55). By far the most frequently expressed meth- 
odological percept found in recent college productivity studies is the ^ 
necessity of controlling differences in student quality among institutions 
so that comparisons of colleges on the basis of the attainments o^ their 
graduates will not merely reflect diversities in entering classes. 

Recently, Richards (39) and Newcomb and Feldman (33) have expressed reser- 
vations that many of the current techniques for partialing out the effects 
of input characteristics may partial out too much (e.g.s by partialing out 
the joint effects of college and student input characteristics). 

A second frequently used mode of analysis, which may be called an 
"analysis to find out who changes," regards the population of college 
students as the population to be sampled, and correlates individual 
differences with respect to changes in aspirations or attitudes with 
actual or reported exposures to various types of college environments. 
Investigators reporting studies conforming to this paradigm include: 

Astin ( 4, 5, 6)5 Gurin and Katz (2l), Thistlethwaite (47 5 485 495 505 515 52)5 
Thistle thwaite and Wheeler ( 53)5 Wallace (56 )• The chief weakness of 
the latter studies has been the fact that errors of measurement on the 
measures of initial status have been largely ignored. Lord (29) and 
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Bereiter ( 9 ) have pointed out that estimates of true scores on measures 
of initial status may be required in order to make the appropriate adjust- 
ments for initial differences between individuals. 

Although many of the methodological problems illustrated in this 
research literature have appeared insurmountable to some observers ( 9, 32) > 
a number of recent developments suggest that the problems may not be in- 
soluble, First, Campbell and Stanley (13) have recently summarized a 
variety of quasi-experiment al designs that may be useful in identifying 
causal relationships in studies of college effects. Second, Lord (30) 
and Porter (36) have suggested modifications in conventional techniques 
of statistical analysis which permit the control of errors of measurement 
on variables indicative of initial status. Finally, Porter (36, pp. 16- 
29) has recently reviewed some of the mathematical literature relevant 
to the use of variables subject to error. Porter observes that the first 
mention of the inappropriateness of least-squares estimates of the struc- 
tural relation between two variables, when the variables are fallible, was 
made in 1878 by R. J. Adcock ( 1 ), and that since that time a considerable 
body of literature on the topic has accumulated. As social scientists 
become more familiar with this literature it seems likely that new solutions 
for old problems may be found. 

Organization of this Report 

This report is a summary of a longitudinal study of a panel of 
students enrolled in 50 colleges and universities. Panel members were 
surveyed by mail questionnaires on three occasions: during the summers 

following the sophomore, junior, and senior years. By repeated measures 
of the aspirations and attitudes of panel members, and concomitant measures 
on a fixed battery of college press scales, it was possible to study "the ^ 
development, and determinants, of the disposition to seek advanced training. 
The study attempted to take seriously the biases that may be introduced by 
the use of fallible measures, and included a number of methodological ana- 
lyses designed to clarify the interpretation of results. 

In Chapter II we shall describe the procedures used to select the 
panel of college students, to determine the factors associated with loss 
of panel members, and to evaluate the characteristics of the scales used 
to assess college environments. 

Quasi-experimental tests of the effects -of entering a specialized 
field of study are described in Chapter III, This chapter also includes 
a comparison of alternative criteria for assessing causal effects in 
quasi-experiments . 

Chapter IV considers the changes exhibited by panel members as they 
progressed through college, regardless of whether all such changes can 
be construed as consequences of exposure to college. In addition, this 
chapter discusses the validity of change in the variabilities of depend- 
ent variables as an indicant of causal effects. 



In Chapter V we consider college experiences and ecological changes 
during college, more or less common to different specialized fields of 
study, that may affect student dispositions to seek advanced training. 

In addition, comparisons are reported relevant to evaluating the robust- 
ness of partial correlation techniques in assessing college effects. 

Finally, Chapter VI discusses the implications of the results, and 
presents conclusions and recommendations. 



^Appendix F summarizes a number of respects in which the final 
analysis of data differed from the analysis originally proposed, and 
briefly describes the reasons for departing from the initial plan. 



CHAPTER II 



METHOD 

In this chapter descriptions of two major aspects of the data- 
collection and analysis procedures are presented: first, procedures 

used in selecting the panel of college students are described, together 
with the results of analyses designed to identify factors associated 
with subject loss in the designated sample of subjects; second, the 
survey materials are described, together with analyses of the statis- 
tical and factorial properties of the college press scales used to 
assess college environments. Descriptions of other major types of 
analyses used to study the effects of college environments upon student 
plans are presented in subsequent chapters in the sections in which the 
results yielded by each mode of analysis are discussed. 



Sample 

Selection of st udents . In Spring, 1965, letters were sent to 109 
four-year colleges and universities requesting (a) permission to survey 
100 of the institution’s students who had sophomore standing during the 
academic year, 1964-65, and (b) a copy of the institution’s published 
student directory containing student names, class standings, and home 
addresses. Only two institutions refused to participate in the study, 
although a much larger number reported they did not have student direc- 
tories with the desired characteristics. Three institutions volunteered, 
and in fact furnished, the desired information from their files. The 
first 50 institutions providing a suitable directory or listing and 
meeting the desired distribution characteristics were selected. At 
each of these schools a random sample of 100 names was selected from 
those listed for students having sophomore standing. 



Table 1 compares characteristics of the designated sample of 5,000 
students with characteristics of the opening enrollments in Fall, 1964 
for all students enrolled in American colleges and universities. It 
can be seen that the designated sample was similar to the larger popu- 
lation with respect to type of control (public vs, private), type of 
institution, and geographical region, of the institution attended. 

Mail surveys. Three mail questionnaires were sent in successive 
years to each panel member. The first mail questionnaires were sent 
in mid-August, 1965, to the 5,000 selected students. During the next 
two successive summers annual follow-up questionnaires were sent to 
each respondent who had remained in progression with the entering college 
class of 1963 and who had returned a useable questionnaire to the imme- 
diately preceding mail survey. On each survey, a reminder was sent in 
the form of a post-card or an additional copy of the relevant survey 
questionnaire to each person who had not replied to the mailing within 



^Table A-1 in Appendix A lists the 50 institutions included. 



TABLE 1 



Comparison of 1964 Opening Enrollments in Higher 
Education with Characteristics of Designated 
and Analyzed Samples of Respondents 



Characteristic 


Percentage of all 
students attending 
institution with 
given characteristic 


Percentage of students 
in sample attending 
institution with 
given characteristic^ 


A.S. 
as a 
% of 

D.S. 


D.S. 


A.S. 




Control: 










Public control 
Private control 


60.5^ 

39.5 


58.0 

42.0 


46.4 

53.6 


18.9 

30.0 


Type: 










University 
Liberal arts college 
Teachers colleges 
Others 


49.3^ 

32.7 

11.5 

6.5 


56. 0 

36.0 
8.0 


51.4 

40.9 

7.7 


2U6 

26.8 

22.7 


Geographical region: 










New England and 
Mideast 


26 . 6^ 


22.0 


29.5 


31.5 


Great Lakes and 
Plains 


21 A 


28.0 


25.6 


21.6 


Southeast and 
Southwest 


23.7 


22.0 


18.2 


19.5 


Rocky Mountain and 
Far West 


21.4 


28.0 


26.7 


22.4 


Others 


.9 









^D. S» refers to the designated sample of 5,000 at 50 institutions j 
while A» S. refer to the sample of ljl78 students in the final panelj 
classified by institution at the beginning of the study. 



^Based only upon enrollments in four-year institutions. 

^Based upon enrollments in both two-year and four-year institutions. 
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the first four weeks* Only panel members who returned useable question- 
naires to each of the three surveys and who reported they would complete 
all the requirements for the bachelor’s degree by September, 1967 were 
included in the analyzed sample* There were 655 men and 523 women meet- 
ing the latter requirements* 

Survey returns* Returns to each of the three surveys are summarized 
in Table 2* It can be seen that the percentages of nonrespondents were 
41*5, 16*2 and 9*6 in 1965, 1966, and 1967 respectively. On the other 
hand, the percentages in category B, which consisted mainly of students out 
of progression with their college class, progressively increased over 
the three years: 5.9, 8.9, and 20,8, Thus, on the first and second 

surveys the most important source of subject loss was nonresponse, while 
on the last survey the most important source of subject loss was with- 
drawal from college or delay in completing college work. In interpreting 
the data on subject loss the reader is cautioned not to assume that a low 
ratio of analyzed to designated subjects necessarily reflects a poor 
response rate. Low ratios may reflect poor response rate, high with- 
drawal rates from entering college class, or both. Factors associated 
with ’’subject loss" are described below, and these factors may or may not 
be associated with -response biases. 



TABLE 2 

Returns to Surveys in 1965, 1966, and 1967 







Survey 






1965 


1966 


1967 


Response Status 


N % 


N % 


N % 



A, Respondent (returning use- 
able questionnaire and 
remaining "in progression" 

with class) 2,329 46,6 1,718 73,8 1,178 68,6 

B, Respondent (returning un- 
useable questionnaire: e,g. 
respondent withdrew from 
college, did not remain in 
progression with class, or 
returned incomplete ques- 



tionnaire) , 


295 


5,9 


207 


8,9 


358 


20,8 


C, Untraceable (questionnaire 
returned with no forward- 
ing address). 


300 


6,0 


26 


1.1 


17 


1,0 


D, Non- respondent 


2,076 


41,5 


378 


16,2 


165 


9.6 


Totals 


5,000 


100,0 


2,329 


100,0 


1,718 


100,0 



Sub.iect loss. The last column of Table 1, which expresses the final 
analyzed sample as a percentage of the designated sample for categories 
used in selecting students, shows that subject loss was greatest among 
students (a) attending publicly-controlled institutions, (b) attending 
universities and teachers colleges, and (c) from the Southeast and South- 
west geographical regions. 

For the remaining analyses of subject loss, separate analyses were 
performed for 1966 and 1967 surveys. Factors associated with subject 
loss were generally similar for the two surveys. 

Subject loss was slightly greater among men than women, especially 
on the last survey (Table 3), but even on the latter the difference in 
the percentages was less than 4 percent. For both sexes, retention of 
subjects in the panel on each of the two surveys was better for subjects 
who reported relatively higher ranks in high school graduating classes. 

TABLE 3 



Subject Loss Associated with Sex and Reported 
Rank in High School Class 



Reported 
rank in high 
school class 




Men^ 






^^omen^ 




D.S. 


A.S. 


AS . ^ 
as ^ of 

D.S. 


D.S. 


A.S. 


A.S. 
as ^ of 

D.S. 




I. 


1966 Survey 








Upper 5 percent 


311 


252 


81.0 


319 


255 


79.9 


Upper 10 percent 


268 


189 


70.5 


254 


190 


74. 8 


Upper 25 percent 


353 


255 


72.2 


234 


176 


75.2 


Upper 50 percent 


224 


161 


71.9 


109 


71 


65 . 1 


Lower 50 percent 


97 


66 


68.0 


16 


10 


62.5 


Don’t know or no 














response 


77 


55 


71.4 


67 


38 


56.7 


Total 


1,330 


978 


73.5 


999 


740 


74.1 




II. 


1967 Survey 








Upper 5 percent 


252 


197 


78.2 


255 


199 


78.0 


Upper 10 percent 


189 


124 


65.6 


190 


131 


68.9 


Upper 25 percent 


255 


164 


64.3 


176 


126 


71.6 


Upper 50 percent 


161 


92 


57.1 


71 


47 


66.2 


Lower 50 percent 


66 


39 


59.1 


10 


5 


50.0 


Don’t know or no 














response 


55 


39 


70.9 


38 


15 


39.5 


Total 


978 


655 


67.0 


740 


523 


70.7 



^D. S. refers to the designated sample, and A. S, to the analyzed 
sample, for the given survey. 
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Table 4 shows that undergraduate grade point average, as reported 
at the end of the sophomore year, was related to subject loss: students 

with higher grade point averages were more likely to be retained in the 
panel on each of the later occasions (Table 4). Similarly, the higher 
the student’s degree aspirations in 1965 the less likely it was that he 
would be eliminated from the panel as a consequence of the outcomes on 
the later surveys (Table 5), 



TABLE 4 



Subject Loss Associated with Undergraduate Grade 
Point Average Reported at EiiJ.of Sophomore Year 





1966 Survev^ 




1967 Survev 


Letter grade 
reported closest 
to grade average 


D.S. 


A.S. 


A.S. as 
% of 

D.S. 


D.S. 


A.S. 


A.S. as 
% of 

D.S. 


A or A- 


129 


108 


83.7 


108 


93 


86.1 


B+ 

B 


983 


727 


74.0 


727 


547 


75.2 


B- 

C+ 


1,010 


741 


73.4 


741 


466 


62.9 


C 

C- or lower 


139 


90 


64,7 


90 


36 


40.0 


No equivalent or 
no response 


68 


52 


76.5 


52 


36 


69.2 


Totals 


2,329 


1,718 


73,8 


1,718 


1,178 


68. 6 



^See footnote a. Table 3 

Finally, Table 6 summarizes subject loss as a function of estimated 
family income and of reported education of the respondent’s mother and 
father. There was a negative relation with family income: somewhat 
greater subject loss occurred on each survey among subjects who reported 
relatively high family incomes in 1965 „ Generally, relationships between 
subject loss and amounts of education of the respondent’s mother or 
father were nonlinear or showed no marked trend. 

Implications of subject loss for objectives of the study . Some of 
the factors associated with subject loss in the designated sample of 
subjects presumably had the effect of increasing the likelihood that 
the final panel of subjects would be disposed to seek advanced graduate 
or professional training. Certainly, this should be the consequence of 
greater subject retention among students ranking high in their high 
school graduating classes, having higher undergraduate grade point 
averages, and having mid-college plans and aspirations to earn advanced 
graduate or professional degrees. Such differential subject loss may 
restrict somewhat the populational generality of the results. However, 
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TABLE 5 



Subject Loss Associated with 1965 Plans to Seek 

Advanced Training 



Response in Summerj 1965 
to: "What are your edu- 

cational plans for the 
future? (Check the high- 
est level of education 
you expect to complete)." 

At least 3 years of college 
or Bachelor’s degree 

Some graduate study or 
Master’s degree 

Professional degree 
(M. D .5 etc.) or academic 
doctorate (Ph.D.) 

No response 14 

Totals 2,329 



501 


72.7 


501 


312 


62.3 


786 


73.9 


786 


544 


69*2 



421 


74.9 


421 


317 


75,3 


10 


71,4 


10 


5 


50.0 


718 


73.8 


1,718 


1,178 


68.6 



1966 Survey' 



D.S. 



A.S. as 
% of 

A.S. D.S. 



1967 Survey 



D.S. 



A.S. as 
% of 

A.S. D.S. 



689 



1,064 



562 



^See footnote a. Table 3. 

the type of subject loss observed may reflect to a great extent the very 
kind of mortality occurring in most college classes from the time of 
initial entry to the time of graduation. In other words, most colleges 
would probably have somewhat better retention among enrollees with high 
ranks in high school graduating class, high college grade point averages, 
and high initial degree aspirations. In any case, the purpose of the 
study was mainly to investigate factors influencing plans to seek advanced 
graduate or professional training, and such differential loss does not 
seriously interfere with this objective. 

Survey Materials 

Three different survey questionnaires were used in the successive 
surveys of panel members in 1965, 1966, and 1967. Each survey question- 
naire consisted of two sections: the first section contained questions 

concerning personal characteristics, educational plans, achievements 
during the past college year, opportunities for special educational or 
counseling experiences (e.g.j honors programs, undergraduate research 
participation), participation in various types of living arrangements 
or extra-curricular activities, and attitudes towards requirements of a 
satisfying job or career (19); the second section, containing parts A 
and B, consisted of 23 college press scales, some of which were similar 
to scales previously described by Thistlethwaite and Wheeler (53), 
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TABT.E 6 



Subject Loss Associated with Reported Characteristics 

of Respondent’s Parents 





1966 Survey^ 


1967 Survey 


Characteristic D.S. A.S. 

reported in (N = (N =. 

1 OA.S 2%329') 


A.S. as 
% of 

D.S. 


D.S. A.S. 

(N = (N = 
1,718) 1,178) 


A.S. as 
% of 

D.S. 
















Estimated family income 
Tall sources before taxes) 


Less than $7,500 


570 


434 


76„1 


434 


310 


71.4 


$7,500-14,999 


1018 


751 


73.8 


751 


533 


71.0 


$15,000 or more 


533 


388 


72.8 


388 


261 


67.3 


Don’t know or no response 


208 


145 


69.7 


145 


74 


51.0 


Mother’s education 


Some high school or less 


340 


260 


76.5 


260 


185 


71.2 


Finished high school 


875 


638 


72.9 


638 


410 


64. 3 


Some college 


588 


447 


76.0 


447 


303 


67.8 


Bachelor’s degree 


402 


289 


71.9 


289 


216 


74.7 


Master’s or higher 


116 


83 


71.6 


83 


64 


77.1 


Don’t know or no response 


8 


1 


12.5 


1 






Father’s education 


Some high school or less 


518 


387 


74.7 


387 


272 


70.3 


Finished high school 


579 


417 


72.0 


417 


266 


63.8 


Some college 


482 


364 


75.5 


364 


243 


66 . 8 


Bachelor’s degree 


399 


295 


73.9 


295 


215 


7.2.9 


Master’s or higher 


346 


255 


73.7 


255 


182 


71.4 


Don’t know or no response 


5 













^See footnote a. Table 3, 

Copies of the questionnaires used in each of the three surveys are 
included in Appendix B. 

Uses made of the questions in the first section of each questionnaire 
are described in subsequent chapters in sections where relevant results 
are discussed. The remainder of this chapter will describe the charac- 
teristics of the college press scales used to assess college environments. 

Instructions for comp leting college press scales . On each of the 
summer surveys students were asked to describe their undergraduate environ- 
ments during the immediately preceding school year. On the faculty press 
scales? the respondent rated on a five-point Likert- t37pe rating scale the 
degree to which given statements characterized the faculty members with _ 
whom he had had most of his courses or had known best, as the following 
instructions indicate: 
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Statements in PART A are about faculty members with whom you have 
had most of your courses or have known best during the past year — 
their courses and teaching methods? their values and emphases? and 
their formal and informal interactions with you. The ratings you 
make here may or may not correspond to the ratings you would make 
of faculty members in other parts of the college or university. We 
do not want you to describe all faculty members in your school. 

Think onl^/ of the teachers with whom you have had most of your 
courses or have known best during the past year. We want you to 
describe their behavior and the effects of their behavior upon you.-*- 

On the student press scales? the respondent rated the degree to which 
given statements characterized the students he had known best or asso- 
ciated with most commonly during the past academic year: 

Statements in PART B are about the undergraduate colleagues you 
knew best during the past year . Your answers to this part should 
tell us what was generally characteristic of the undergraduate 
students you knew best? identified with? or associated with most 
commonly during the past year. The ratings you make for your per- 
sonal associates in your undergraduate school may or may not cor- 
respond to the way you would rate undergraduates in general or 
other groups of students at your college. Describe only those 
students you knew best and associated with most commonly. They 
may? or may not? be students in your major field? living quarters 
or campus clubs. 

Except for the minor discrepancies noted? the instructions and press 
items for the college press scales were identical in each of the surveys. 
On the later surveys? the following paragraph was added in the general 
instructions: 

Although you answered a similar set of items last year? your 
college environment has undoubtedly changed in several respects 
since you last reported. We want to study permanence and change 
in college environments and to relate such changes to the develop- 
ment of student career plans. So please complete the following 
items even though many of them are similar to items in the survey 
you completed last year. 

Reliabilities of the college press scales . Descriptive statements 
were designed to yield scores on 12 faculty press scales and 11 students 
press scales. Each scale contained 6 items? 3 keyed so that "Agree” 



^The instructions used in the 1965 survey did not have the phrase? 
"during the past year" underlined; this phrase was underlined in later 
surveys , 

^The 1965 survey did not contain the phrase "during the past year" 
in the first sentence of this paragraph? though this phrase was included 
in the second sentence. Instructions for later surveys were as shown abo^;e. 
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responsGS wgtg WGightGd morG hGavily? and 3 kayad so that Disagraa 
rGsponsGS wg!tg waightad mora haaviXy# Kiidar— Richardson formiiia 20 
raliability astimatas (is) wara astimatad saparataly for man and 
woman on tha basis of responsas to each survay. Among man the scale 
reliabilities on the initial survey ranged from .52 to .86, with a 
median value of .75; only four of the scales had reliabilities below 
.65— Faculty Evaluations of Ability, Faculty Press for Science, 

Student Press for Academxc Achievement, and Student Press for Voca— 
tionalism. Among women the scale reliabilities on the initial survey 
ranged from .48 to .84, with a median value of .76; only two of the 
scales had reliabilities below . 65— Faculty Press for Science and 
Student Press for Vocationalism. Appendix C lists each scale ^to- 
gether with the six descriptive items (Table C-l) and the reliability 
estimates (Table C-2) for each scale. 

Factor analysis of item intercorrelations . In order to verify 
the clustering of items into scales on the basis of item content and 
previous research (53) factor analyses of item intercorrelations were 
performed. Separate analyses were done for the 72 faculty press items 
and for the 66 student press items, using the pooled responses of all 
1,178 panel members to the 1966 survey.! 

Of the 12 clusters of faculty press items, 9 emerged as having 
relatively simple factor interpretations which corresponded with the 
manifest content of the clusters. Table 7 shows the factor pattern 
coefficients for each item on the relevant factors. These coeffi- 
cients represent the beta weights for predicting the given item score 
from the factors, and the absence of an asterisk in the upper half of 
this table indicates that the given item had an appreciable loading 
only on the given factor. The signs of these coefficients generally 
Tiflect whether the item was coded "T” or ”F.” For example, the 
first and second items in the first scale. Faculty Enthusiasm for 
Intellectual Values, had factor-pattern coefficients of .79 and -.61, 
respectively, and Table C-l (Appendix C) shows that these two items 
(items 27 and 39) were coded and "T,” respectively. This relation- 
ship arises from the fact that in computing item intercorrelations. 



lln these, and in the subsequent analyses based upon scale inter- 
correlations, principal axes factor analyses with ones in the diagonals 
of the correlation matrix were performed. The resulting factors were 
rotated to orthogonal simple structure by means of the Varimax method, 
and then an oblique rotation was performed using the Promax method with 
k = 4 (23). Both in the analyses for items and in that for scale scores 
(described in the next section of this chapter) the Promax method re- 
sulted in superior simple structure. In the analysis for faculty press 
items, 56 percent of the loadings from the Varimax rotation fell within 
the hyperplane count (+ .10) as compared with 75 percent of the loadings 
for the Promax rotation. In the analysis for student press items, 64 
percent of the loadings from the Varimax rotation, and 77 percent of the 
loadings from the Promax rotation fell within the hyperplane count. In 
the analysis for scale scores the corresponding percentages were 61 and 
78, respectively. In all three analyses it was evident that the data 
were more readily interpreted in terms of the oblique factors. 
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TABLE 7 



Factor Pattern Coefficients for Items in Faculty Press Scales 



Factor Factor-pattern coefficient^ 

on which — 

coefficients Ordinal position of item in 

are content cluster 



Scale reported 1st 


2nd 


3rd 


4th 


5 th 


6th 




I. Items Clusters 


with 


Simple 


Factor 


Interpretations 




1. 


Enthusiasm for 
Intellectual Values 


A 


79 


-61 


56 


-64 


88 


-60 


2. 


Supportiveness 


B 


-54 


67 


50 


-81 


50 


-65 


3. 


Vocationalism 


C 


-82 


86 


85 


-65 


-51 


43 


5. 


Compliance 


D 


-75 


83 


^■60 


68 


85 


-52 


7. 


Humanities 


E 


-22* 


90 


-73 


93 


70 


-75 


8. 


Advanced Training 


F 


70 


-56 


-48* 


68 


45 


-28* 


10. 


Adequacy as Positive 
Role Models 


G 


57 


-57 


76 


-38* 


-24* 


44* 


11. 


Excellence of 
Teaching 


H 


70 


-84 


77 


-37* 


86 


-68 


12 0 


Affiliation 


B 


81 


-47 


-88 


85 


-87 


74 




II, Item Clusters 


with 


Complex 


Factor’ 


Interpretations 




4. 


Independent Thinking 


B 




-34 


-40 


24 




32 




A 


57 






36 


-37 


24 






I 




43 


39 


-25 


38 




6. 


Evaluations of Ability 


B 






-50 


31 




-50 






J 


-80 


76 


46 












K 








20 


67 




9. 


Science 


L 


77 




69 




68 








M 




74 




68 


-33 


73 



^Coefficients less than 20 are not shown and decimals are omitted. 
These coefficients are the beta weights for predicting the given item 
score from the given factor. Ordinal positions refers to the orders 
of items as shown in Appendix C. 

*These items had factor-pattern coefficients exceding 30 on one 
or more other factors. Asterisks are shown only in Part I of this table. 

no attempt was made to apply the reflected weights for items coded ”F” 
(though the correct weights as described in the footnote to Table C-1 
were applied in computing all scale scores in subsequent analyses). 

Two of the scales, Faculty Supportive ness and Faculty Press for 
Affiliation, had a correlation of .76 for 1966 responses, and it is 
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therefore not surprising that the items in these two scales can be 
accounted for by a single factor (factor B). Of the three faculty item 
clusters having relatively complex factor Interpretations (Part II of 
Table 7) the last is the most interesting: in the cluster of items 

designed to assess faculty press for science the three items having 
high coefficients on factor L were all coded "F” while the three items 
having high loadings on factor M were all coded ”T.” Moreover, the 
correlation between the obliq^ue factors L and M was only (lO. Thus 
there is evidence that the "T” and items in the Faculty Press for ^ 
Science scale do not have much in common. The low pretest reliabilities 
for this scale (.58 and .48 for men and women, respectively) suggest a 
similar conclusion. Nonetheless, except for the three scales noted, the 
factor analysis provided striking confirmation of the clustering of the 
faculty press items . 

Table 8 shows that of the 11 clusters of student press items, 10 
had relatively simple factor interpretations corresponding with the 
manifest content of these clusters. Two of the student scales. Student 
Press for Reflectiveness and Student Press for Intellectualism, had a 
correlation of .73 for 1966 responses, and Table 8 indicates that the 
items of these two scales can be largely accounted for by a single 
factor (factor C). Only the item cluster for student press for academic 
achievement had a relatively complex factorial interpretation. 

i 

Factor analysis of scale intercorrelations . Each of the 23 college 
press scales was administered at the completion of the sophomore, junioij 
and senior years of college, yielding a total of 69 scale scores for 
each subject. These scores were intercorrelate d for all 1,178 panel 
members, and a factor analysis performed by the methods already described. 
Of the 14 factors extracted, 13 appear to have fairly simple interpreta- 
tions. The first three oblique factors (A', A’’, and A''') shown in 
Table 9 each tend to predict scores on the same 10 press scales. However, 
factor A’ best predicts scores obtained on these scales at the end of the 
sophomore year; factor A" best predicts the corresponding scale scores 
at the end of the junior year; and factor A'” best predicts scores on 
these scales at the end of the senior year. For example. Table 9 shows 
that factor A' (a sophomore-year factor) had beta weights of .88 and .86, 
respectively, for predicting 1965 scores on scales 2 and 12 (Faculty 
Supportiveness and Faculty Press for Affiliation). However, this same 
factor had beta weights (factor-pattern coefficients) of only .05 and 
.06, respectively, in predicting 1966 scores on these same scales (the 
latter weights are not shown in Table 9). Similarly, factor A" (a 
junior- year factor) had beta weights of .79 and .76 for predicting 
1966 scores on scales 2 and 12, respectively, but this same factor had 
beta weights of -.01 and -.05, respectively, for predicting 1965 scores 
on these same scales. An analogous state of affairs exists for factor 
A’’’ (a senior-year factor). 

The correlations shown in Table 10 may help to illustrate the nature 
of the first three oblique factors, which clearly represent ’’occasion” 
factors. Thus, it may be seen that sophomore-year scores on scale 2 
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TABLE 8 



Factor Pattern Coefficients for Items in Student Press Scales 



Factor Factor-pattern coefficient^ 

on which Ordinal position of item in 

coefficients content cluster 



are 



Scale 


reported 


1st 


2nd 


3rd 


4th 


5 th 


6th 


I. Item Clusters with Simple Factor Interpretations 




13. Estheticism 


A 


-95 


67 


79 


-95* * 


-100 


86 


15. Vocationalism 


B 


60 


-37* 


-63 


67 


55 


-65 


16. Reflectiveness 


C 


54 


-67 


-30* 


91 


92 


-88 


17. Unfavorable Self- 
















Evaluations 


D 


7V 


-77 


-79 


77 


59 


-34* 


18. Advanced Training 


E 


-89 


85 


38 


-20* 


31* 


-35* 


19. Science 


F 


-53* 


58 


86 


-91 


82 


-92 


20. Opposition to Faculty 
















Influence 


G 


96 


-86 


95 


68 


-03* 


-08* 


21. Intellectualism 


C 


33* 


-24 


-39* 


88 


43* 


-57 


22. Affluence 


H 


26* 


81 


-74 


-47* 


84 


-15* 


23. Playfulness 


I 


76 


-54* 


-42* 


76 


69 


-61 


II. Item Cluster with Complex Factor Interpretations 




14. Academic Achievement 


I 








-56 








J 


-44 


61 


88 




-32 


68 




K 


76 


-21 


-37 


36 


86 


-29 



^See footnote a? Table 7. 

*These items had factor-pattern coefficients exceeding .30 on one 
or more other factors. Asterisks are shown only in Part I of this 
Table. 



correlated highly (.73) with sophomore-year scores, but only moderately 
with junior-year (.40) and senior-year (.24) scores, on scale 12. In 
other words, knowing that a student^ s teachers in the second year of 
college were highly supportive would enable one to predict with some 
accuracy that these same teachers were also warm and friendly (high in 
affiliation), but would enable one to predict with much less accuracy 
the affiliation of the teachers the student knew best in the junior and 
senior years of college. More generally. Table 10 illustrates that 
scores on different press scales with high loadings on one of the A 
factors tend to correlate highly when the scores were all obtained at 
the same time, but show considerably lower intercorrelations_ on the 
average when the scores were obtained at different times. These find- 
ings indicate that the faculty members described on these faculty press 
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TABLE 9 



Factor Structure of College Press Scale Scores Obtained at 
Completion of Sophomore, Junior, and Senior Years in College 



A’ — sophomore year 
factor; 

A”— junior year 
factor; 

» » — senior year 
factor; 



2. Faculty Supportiveness 

12. Faculty Press for 
Affiliation 

10. Faculty Adequacy as 
Positive Role Models 

11. Faculty Excellence of 
Teaching 

4. Faculty Press for Inde- 
pendent Thinking 

1. Faculty Enthusiasm for 
Intellectual Values 

6. Faculty Evaluations of 
Ability 

8. Faculty Press for 
Advanced Training 

7, Faculty Press for 
Humanities 

20. Student Opposition to 



Soph. 
.88 

.86 
.78 
.73 
.80 
.72 
.74 
.64 
.52 



Jr. 


Sen. 


.79 


.85 


.76 


.86 


.81 


.85 


.85 


.77 


.75 


.75 


.76 


.73 


.68 


.79 


.62 


.58 


(.47) 


(.43) 


-.56 


-.48 



B' 

C' 

D' 

E 



.84 



.77 



^ 69 _ 

.73 

.73 



FacuIty“Press for" 

Compliance — 

-- 7. Faculty Press for 

_Humanities ^54 

97 Faculty Press for 

_Science lII 

paculty Press for 

Vocationalism *66 .72 

15. Student Press for 



Is7“Student Press for 

Estheticism ^87 .91 .83 

16. Student Press for 

Reflectiveness *86 .«/ 

21. Student Press for 

Intellectualism i73 • 

l97"Student Press forScience .81 .82 .ac5 

18. Student Press for 

Advanced_Training (i^l) ;^61^ 

l77“Student Press for Unfavor- 

able_SelfrEyaluatiqns 

Student Press for 

Playfulness ■*- — 

22 . student Press for 

Affluence ^89 .85 



I 

J 
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TABLE 9 — Continued 







Factor-pattern coefficients ^ 


Factors 


College Press Scales 


Soph. 


Jr. 


Sen. 


K 


14. Student Press for 
Achievement 


.61 


,79 


.79 



ri’ — sophomore year l8. 


Student Press for 




factor 


Advanced Training 


. 64 


14. 


Student Press for Aca- 






demic Achievement 


(.55) 


21. 


Student Press for 






Intellectualism 


(.52) 


19. 


Student Press for 






Science 


(.46) 



^Coefficients are beta weights in predicting the indicated scale 
scores from the factor listed in the first column. The factor-pattern 
coefficients listed are the highest ones for the given scale scores. 
Exceptions to the latter rule are indicated by coefficients in parenthe- 
ses, and in these cases the factor having a higher weight for predict- 
ing the given scale scores is shown elsewhere in the table. 



TABLE 10 



Product-Moment Correlations Between Scores of 1,178 Students on 
Faculty Supportiveness and Faculty Press for Affiliation Scales 





Year 


Scores on Scale 2-Faculty Support! veness 


Scale 


scores on 
given scfliie' 
were obtained 


Year scores were obtained: 
Sophomore Junior Senior 

(1965) (1966) (1967) 



12-Faculty Press 


1965 


.73 


.43 


.42 


for Affiliation 


1966 


.40 


.76 


.47 




1967 


.24 


.48 


.77 



scales either differed from year to year or were seen as having character- 
istics which differed from year to year. 

The three A factors may be interpreted as faculty rapport factors. 

The factor-pattern coefficients show that students tended to evaluate the 
teachers they knew best during a given year in terms of a fairly global, 
'’good rapport” vs. "bad rapport” dimension. If a student saw his teachers 
in a given year as highly supportive he also tended to see them as (a) 
high in affiliation, (b) adequate as positive role models, (c) excellent 
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teachers, (d) interested in developing independence of judgment, (e) 
enthusiastic about intellectual values, (f) providing positive evalua- 
tions of his ability, (g) encouraging students to do graduate work, 
and to a somewhat lesser extent (h) encouraging students to take courses 
in the humanities. Finally, the negative coefficients for scale 20 ^ 
shown in Table 9 mean that students exhibiting good rapport with their 
teachers in a given year tended to report that the undergraduate stu- 
dents with whom they associated most that year showed little opposition 

to faculty influence. 

One interpretation of these three factors is that the students \^eice 
manifesting a general "halo effect," For example, Issacson, et al. (24) 
interpreted a similar teacher "skill" factor they found as representing 
such a judgmental error. However, we have no evidence that the high 
correlations between selected trait attributions were spurious. An 
alternative interpretation, equally compatible with the data, is that 
the clustering we observe in the scales loading highly on the A factors 
arose from the objects being described. In other words, faculty attri-^ 
butes may in fact co-vary as students perceive them to co-vary» Faculty 
members who tend to be supportive, may also tend to be high in affilia- 
tion, admirable as role models for students, excellent teachers, insis- 
tent upon developing independence of judgment, etc. 

Table 10 suggests the possibility that the oblique A factors may 
be intercorrelate d, and this was in fact the case. The intercorrela- 
tions among the 14 factors are summarized in Table 11, and it can be 
seen that factors A’, A”, and A”’ showed moderate intercorrelations. 
Clearly, there was some degree of stability, from year to year, in the 
kind of rapport a student seemed to enjoy with his college teachers. 

The remaining 10 interpre table factors in Table 9, unlike those 
just considered, were defined by the content of the relevant scales and 
only negligibly by the time at which these scale scores were obtained. 
For these factors, therefore, there is considerable stability in the 
particular faculty and student press to which the student reported 
being exposed from year to year. For example, a student who reported 
being exposed to strong faculty press for science (factor D) at the 
end of his sophomore year, tended to report similar press at the end 
of his junior and senior years. Similarly, a student reporting much 
student playfulness (factor l) among his close friends in 1965, tended 
to report similar playfulness in 1966 and 1967. In Table 9, we^see 
that factor D had beta weights of .73, .76, and .69 for predicting 
scores on the scale. Faculty Press for Science, obtained in 1965, 1966, 
and 1967, respectively. Parenthetically, 'i^e may note that despite the 
heterogeneity of the items in the scale for assessing faculty press 
for science (Table 7) nonetheless the scale had sufficient coherence 
for scores on it to be predicted well on each measurement occasion by 
a single factor (factor D in Table 9). The results in Tables 9 and 11 
suggest that the 13 interpre table factors may be named as follows 
(where Roman numerals in the name indicate that the factor is specific 
to the college year indicated)? 
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TABLE 11 



Table of Intercorrelations of Oblique Factors Extracted 
in Factor Analysis of College Press Scale Scores 





Product- 


■Moment Correlations 


^Decimals omitted)^ 




Factors A' 


A" A' " 


B C D E F 


G H 


I J K L' 


A' 


54 50 


40 


25 






A' ' 


55 


38 


25 






At t t 


— 


42 


33 






B 




— -23 28 


-21 






C 




— -20 








D 




.... 








E 




30 








F 




— 


34 


-22 23 




G 






— 


21 -23 




H 






........ 






I 








— 29 




J 












K 








mmmmmm 




L' 








— 





^Only correlations having an absolute value of .20 or greater are 
shown . 



Factor 



Name 



A' Faculty Rapport? II 

A' ' Faculty Rapport? Ill 

A' ' ' Faculty Rapport? IV 

B Faculty Exactitude 

C Faculty Humanism 

D Faculty Scientism 

E Faculty and Student Vocationalism 

F Student Humanism 

G Student Scientism and Professionalism 

H Student Competition 

I Student Playfulness 

J Student Affluence 

K Student Achievement 



The last factor (L’ ) in Table 9 does not appear to be readily inter- 
pretable? except that it is clearly a sophomore -year factor? since its 
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sizeable loadings are exclusively on scores obtained in 1965. 

Student reports of te achers and students described . Some data 
obtained on the teachers and peers respondents claimed they were 
describing in the ratings on faculty and student press items. Un- 
fortunately, identical questions concerning the objects of description 
were not repeated on all three surveys. Nonetheless these reports are 
useful, as we shall see, in interpreting some of the analyses to be 
reported in later chapters. Table 12 shows that during the first two 
survey years most respondents indicated that they were describing 
student colleagues they had met in their dormitories, rooming houses, 
or fraternities. However, there was a tendency for a larger propor- 
tion of the junior-year, than of the sophomore-year, reports to 
describe students met in the respondent’s major field of study. The 
large majority of respondents said they were either describing exclu- 
sively or primarily same-sex student colleagues. At the time of the 
last survey, about three-fourths of the panel members said the faculty 
members they had described were in their major field of study, while 
only about one— third of the panel said that most of the student col- 
leagues described were in their major field of study. 

Summary. Each of the college press scales designed to assess 
college environments had sufficient reliability to justify group com- 
parisons. Most of the scales had relatively simple factorial inter- 
pretations. Factor analyses showed that most of the scales had 
moderately high internal consistency, and can be described as assess- 
ing some 13 interpretable dimensions (factors) of college press. 

Three of the factors were temporal factors for predicting press at 
different stages of college, and referred to a fairly, global faculty 
rapport factor. The remaining 10 factors referred to dimensions 
corresponding fairly closely to those anticipated in the design of 
the survey materials. 



^Ambiguities concerning the interpretation of factor L’ arise in 
part from the results of a factor analysis, similar to the ones des- 
cribed, performed on the intercorrelation matrix of the oblique fac- 
tors (partially reported in Table ll). It was found that factors G 
and L' had positi ,’e and negative loadings, respectively, on a higher- 
level factor, even though both of these factors had sizeable positive 
loadings in the lower-order analysis on 1965 scores on scale 18. 

Other results of the higher— order facior analysis confirm the factor 
structure which is suggested in Table 11. For example, oblique fac- 
tors A’, A’’, A’’’, and (to a lesser extent) F loaded highly on a 
second higher— order factorj on a third higher— order factor, factors 
B and D had positive loadings and C a negative loading; on a fourth, 
factors I and J had positive loadings; and on a fifth, factors E and 
F had negative and positive loadings, respectively. 



\ 
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TABLE 12 



Respondent’s Statements Concerning Faculty Members and 
Student Peers Described on College Press Scales 



Question 



Percentage of respondents 
maKing given response 

Men Women 

(N=655) (N=523) 



I, 1965 and 1966 Surveys 



Where did you meet the under- 
graduate colleagues you will 
be describing? (Circle the 
one which best applies.) 

Dormitory or rooming house 
My fraternity or sorority 
(or equivalent) 

Campus activities 
Class in my major field 
Other 

Does this group include both men 
and women? (Circle one.) 

Noj men only 
Yesj but primarily men 
Yesj but primarily women 
Noj women only 



1965 1966 1965 1966 



32 


22 


52 


39 


26 


25 


15 


16 


14 


12 


11 


10 


15 


22 


12 


18 


13 


19 


10 


17 



46 


41 


— 


— 


51 


55 


09 


13 


2 


04 


66 


66 
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II. 1967 Survey 



Are most of the faculty members 
you have just described in your 
major field of study? 

Yes 

No 



73 

27 



78 

21 



Are most of the student colleagues 
you will be describing in your 
major field of study? 



Yes 

No 

No response 



37 

61 

2 



36 

63 

1 
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CHAPTER III 



SOME EFFECTS OF ENTERING A FIELD OF STUDY 

In this chapter the major objective is to summarize quasi- 
experimental tests of the hypotheses that entry into a field of study 
has the effect of producing changes in student dispositions and in 
the faculty and student press to which the student is exposed . In 
the course of the analysis we shall consider a number of alternative 
methods for assessing effects, and attempt to identify conditions under 
which conventional analysis of covariance methods may be trusted not 
to lead to spurious results « These methodological analyses and the 
conclusions to which they led are also discussed in this chapter o 

The Opportunity and Problem of Quasi - Experimental Comparisons 

The structure of the American undergraduate curriculum provides 
the basis for quasi-experimental comparisons of the effects of entering 
a field of study. Such comparisons differ from true experimental com- 
parisons in that, in the latter, subjects have been randomly assigned 
to treatment groups. Also such comparisons differ from simple longi- 
tudinal observations on panels of respondents in that, in the quasi- 
experimental comparison, there is always a presumption that different 
treatments have their maximal impacrs during the interval between a 
pretest and a posttest, so that treatment differences offer one 
plausible explanation for posttest differences between groups, Campbell 
and Stanley (13) have described numerous designs which provide such 
comparisons. Students in professional as well as liberal arts programs 
in this country typically are required to take courses in a variety of 
academic fields during the first two college years, and then tend to 
specialize in a single major field during the last two undergraduate 
years. As a consequence it can be expected that the effects of enter- 
ing a major field of study will be exhibited maximally during the last 
two years of college. The present chapter is concerned mainly with a 
quasi-experimental test of the effects of entering a major field of 
study. 

Are students exposed to different kinds of teacher and peer press 
as a consequence of entering a major field of study? If so, how do 
fields of study differ with respect to changes in faculty and student 
press which are the consequences of such specialized study? How do 
fields of study differ with respect to their effects upon student 
aspirations and values? Bereiter (9 ) points out that it is difficult 
to answer such questions because different fields of study attract 
different kinds of students, Bereiter and Friedman (10) and Warnath 
and Fordyce (5?) found that when a pretest is obtained before students 
formally declare, and enter, their major field of study it can be pre- 
dicted with confidence that students classified by their prospective 
fields of study will differ markedly in personality and values on the 
pretest. The problem of adequately controlling group differences on 
the pretest in order to compare the effects of field of specialization 
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on the posttest has appeared to be insoluble to Bereiter (9 ) and Lord 
(32)„ Covariance analysis has been the conventional technique for 
removing the effects of pretest differences between groups; however? 

Lord ( 30, 315 32) has argued that the conventional analysis of covariance? 
which ignores errors of measurement on the covariable? cannot be counted 
on to make proper allowance for uncontrolled preexisting differences 
between groups. 

Lord ( 30 ) described a significance test for covariance analysis 
which takes account of unreliability in the covariable? but Lord’s U 
statistic is limited to the comparison of only two treatment groups, 

Mor (3 recently? Porter (36) has proposed a more generally applicable 
solution to the problem of estimating the regression of the dependent 
variable upon the true parts of one or more fallible covariables (i,e,? 
of estimating the structural relationship). Briefly? Porter’s solution 
consists in performing the analysis of covariance using estimated true 
pretest scores as the covariable , He has shown by Monte Carlo methods 
that this mode of analysis yields good estimates of the structural 
relationship when the reliability of the covariable is ,7 or greater 
and sample sizes are 20 or greater. Porter also found that when the 
reliability of the covariable was only ,5 the agreement of the generated 
distributions of F to their theoretical counterparts was not quite as 
good? but still close. 

Porter’s method requires an estimate, of the reliability of the 
covariate? but such reliability measures wgre not available for all 
of the variables to be considered. Accordingly? a new method based 
upon the principle of contrasting paired-treatment and internal regres- 
sions was developed for testing hypotheses involving these variables. 

Treatment Groups 

On the basis of each student’s initial response concerning his 
major field of study ’’during the next two years of college” he was 
classified into a major field group. Any student reporting an under- 
graduate major field of study in 1967 different than that reported two 
years earlier was reassigned to a miscellaneous group. Men were finally 
assigned to 14 fields and women to 11 fields as shown in Tables 13 and 
14, 



For the purposes of this analysis? two of the press scales (Faculty 
Press for Humanities and Faculty Press for Science) may be regarded as 
’’marker variables?” since scores on these scales should reflect highly 
predictable changes in the curriculum of students as they progressed 
through college. For example? one would expect that majors in the 
physical sciences and engineering would show increases in faculty press 
for science? and decreases in faculty press for humanities as they 
progress in their specialized fields of study. Majors in English? fine 
and applied arts? and history? on the other hand? would be expected to 
show the opposite trends. If our analysis had not revealed these trends? 
we might well have questioned the validity of the press scales? the 
appropriateness of the analytic methods? or both, 
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Ecological Effects of Entering a Field of Study 

For each of the 23 college press scales two analyses of covariance 
were performed using as the covariable estimated true pretest scores 
(ice., 1965 true press scores), following the procedures described by ^ 
Porter (36). In one analysis 1966 press scores, and in a second analysis 
1967 press scores, comprised' the dependent variable. Covariable 
abilities used in these analyses were estimated separately for men and 
women (cf. Chapter II ). 

The analyses of covariance using true pretest scores as the cova- 
riable are considered the best available tests of causal effects, and 
the major tests of the ecological hypotheses were based upon these ^ 
analyses which are summarized in Tables 13-16. An entry is shown in 
these tables for each analysis yielding an F-ratio (for testing the 
significance of the differences between adjusted means) significant at 
the .05 level or higher. Adjusted means listed under the "1" columns in 
these tables represent mean press scores for fields of study based upon 
reports after the completion of the junior year, adjusted to remove 
differences between fields in estimated true scores on the pretest. 
Similarly, adjusted means listed under the "2" columns of these tables 
represent mean press scores for fields based upon reports after the 
completion of the senior year of college, adjusted to remove differences 
between fields in estimated true scores on the pretest. Thus these two 
sets of adjusted means can be considered effects of entering a specialized 
field of study over one-year and two-year intervals, respectively. In 
these tables, the deviation scores shown are the differences between the 
adjusted mean of a field and the adjusted grand mean score for all fields. 
Positive deviations represent greater increments in the given press. 



^In the text only the major trends appearing in the data can be 
discussed, but the reader may be interested in mvaking additional compa- 
risons between pairs of fields on particular scales. To calculate an 
F-ratio for estimating the significance of the difference between means 
for any two fields, the square of the algebraic difference between the 
tabled deviation scores may be divided by the product of the average 
effective error per unit (shown at the bottom of each column) and (1/N^ + 
l/No), where N. and N2 are the N’s for the fields to be compared. For 
men (Tables 13'^and 16) the degrees of freedom for evaluating such an 
F-ratio are 1 and 640; for women (Tables 14 and 15) the corresponding 
degrees of freedom and 1 and 511. This formula for evaluating the 
significance of the difference in adjusted mean scores between any two 
fields is one suggested by Cochran and Cox (l5, p.79), and takes due 
account of the unequal sizes of the treatment groups. Some F-ratios 
for comparing individual pairs of fields are reported in Tables 19 and 
20, and in Tables D-1 and D-2 of Appendix D. 
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Effects upon faculty press to which stu dents were exposed » In 
tables 13, 14, and 15 it may be seen that the expected effects upon 
the marker variables (faculty press for science and faculty press 
for humanities) were exhibited by both men and women. Students major- 
ing in engineering and in the physical sciences exhibited the expected 
increases in faculty press for science? and those majoring in English? 
the fine and applied arts and history showed the expected increases in 
faculty press for humanities. 

Sizeable effects were also observable on the scale? Faculty Press 
for Vocationalism. Among men? specialization in business administration? 
the health professions (mostly students majoring in pharmacy)? or engi- 
neering was associated with a relative increase in press for vocational- 
ism? while specialization in education? English? or political science was 
accompanied by a relative decrease in such press (Table 13). Among women? 
entry into the health professions (mainly? nursing training) and education 
produced relative increases in faculty press for vocationalism? while 
entry into sociology? mathematics? psychology? and English produced rela- 
tive decreases in such press (Table 14). 

Effects upon faculty press for advanced training were less marked 
but nonetheless statistically significant. Among men? entry into physics 
or chemistry was accompanied by an increase in such press? while entry 
into fine and applied arts? the health professions? or education meant a 
relative decrease in such press (Table 13). Among women entry into 
nursing produced an increase in press for advanced training? while entry 
into sociology produced a decrease in such press (Table 15). 

The effects on the remaining faculty press scales shown in these 
tables were of borderline significance (p<.05) and without further 
comparisons of the type suggested above one should be cautious in making 
comparative statements for fields other than the highest and lowest 
ranking fields. Among men? entry into the biological sciences or 
political science increased the favorableness of faculty evaluations of 
ability more than entry into education (Table 13). Among women? entry 
into nursing as a major field of study increased both the favorable- 
ness of faculty evaluations of ability (Table 15) and faculty support- 
iveness (Table 14) more than entry into sociology or anthropology. 

Among women specialization in the biological sciences increased the 
likelihood of being exposed to teachers students rated as excellent 
more than specialization in the fine or applied arts (Table 15). 

Finally? it is of some interest that there was no evidence of 
differential field effects with respect to the following faculty press: 
adequacy as positive role models? affiliation? compliance? enthusiasm 
for intellectual values? and independent thinking. 
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TABLE 14 



Adjusted Mean Scores on Selected Faculty Press Scales 
of 523 Women in 11 Fields of Study 



Number 

of 

stu- 

Major Field of Study denis 



Deviation Scores 

Press for Support- 

Humanities iveness 

12 12 



Press for 
Vocationalism 

— 5 



English 


61 


Mod, For. Lang, 


34 


Fine, Applied Arts 


33 


History 


20 


Psychology 


25 


Sociology, Anthro. 


27 


Biol. Sciences 


24 


Health Prof. 


26 


Miscellaneous 


195 


Education 


58 


Math, , Statistics 


20 


Total 


523 


Average effective 




error per unit 





F-ratio (homogeneity of 
adjusted means) 

F-ratio (homogeneity of 
regression) 



1.85 


2,27 


00 


1,60 


2,22 


.33 


1.99 


1.06 


.05 


.27 


.95 


-1.24 


- ,96 


.05 


- .94 


-1.41 


- .28 


-2.04 


- ,43 


,40 


.31 


-1.81 


- .47 


1.89 


- .46 


- ,64 


.01 


- ,01 


-1.28 


.53 


-1.49 


-2.07 


.04 


12.38 


14.97 


14.62 



4.78** 4,80** 1,93* 

1.89* 2.41** 1.87* 



- ,32 


- .91 


-1.08 


-1,01 


.64 


- .77 


- .21 


- .12 


- .82 


- .23 


- .34 


- .79 


.94 


-1.98 


- .95 


- .90 


-1.51 


=-1.17 


.84 


- ,02 


1.21 


•2.83 


2,06 


2.84 


- .10 


- .02 


.21 


- .11 


1.57 


1.29 


- .11 


- .62 


-1.43 


15.49 


11.92 


14.51 



2.05* 3.89** 3.71** 



1.53 1.90* 1.54 



*p<.05 

** p <,01 

Effects upon student press to w hich students were exposed . As we 
have seen in Chapter II, at the time of the final survey after completion 
of the senior year, about three fourths of the respondents said that most 
of the teachers they had described were in their major field of study but 
only about one third of the respondents indicated that most of the stu- 
dents they were describing were in their major field of study, 
the more striking therefore that the treatment classification by the re- 
spondent's major field revealed such pervasive effects upon student press. 

By far the most marked field effects with respect to changes in 
student press were observed on the scale. Student Press for Science, 

Table 16 shows that men majoring in physics or chemistry, the health pro 
fessions, biological sciences, and engineering exhibited marked increases 
in student press for science, while those majoring in fine and applied 
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TABLE 15 



Adjusted Mean Scores on Selected Faculty and Student Press Scales 

of 523 Women in 11 Fields of Study 









Deviation 


Scores 










Student 


Fac, 


Fac, 


Excel- 


Fac, 


Student 




Number 


Press 


Press 


Press 


lence 


Eval, 


Press 




of 


for 


for 


for Adv. 


of Fac. 


of 


for Es- 




stu- 


Science 


Science Trng. 


Teach. 


Ability theticism 


Major Field of Study 


dents 


•2 


2 


2 


2 


1 


2 


Biol. Sciences 


24 


2,90 


1.27 


, 63 


1,85 


,01 


- ,77 


Health Prof„ 


26 


2,22 


lo26 


3.03 


,41 


1,77 


-1.01 


Psychology 


25 


,69 


1,76 


- .11 


1.09 


,96 


- ,84 


Math. , Statistics 


20 


,29 


,96 


- ,86 


- .74 


- ,83 


.16 


English 


61 


,05 


- .96 


- ,51 


1,26 


- ,07 


.86 


Miscellaneous 


195 


,06 


- ,06 


,17 


- .39 


- ,07 


.10 


Education 


58 


- ,12 


,15 


- ,89 


- .73 


.43 


-1,25 


Sociology, An thro. 


27 


- ,36 


,03 


-1,07 


- . 66 


-1,55 


- .14 


History 


20 


- .52 


- ,47 


,55 


1.08 


-1.16 


.50 


Fine, Applied Arts 


33 


-1,89 


- ,24 


- ,15 


-1.47 


- .63 


1.18 


Mod, For. Lang. 


34 


-2,24 


-1,44 


- .09 


.55 


.73 


,50 


Total 


523 














Average effective 
















error per unit 




14,77 


8.20 


14,43 


18.42 


11.58 


13.65 


F-ratio (homogeneity of 














adjusted means) 




3,95** 3.32** 


2.57*' 


t 2.17* 


2.20* 


1.82* 


F-ratio (homogeneity of 














re gression) 




1.87* 


,73 


,96 


3.23*‘ 


* 2.01* 


1.69 



*p < o 05 

**p < . 01 



arts 5 education, business administration, and history showed marked 
decreases in such press. Similar field effects were observed among 
women (Table 15). 

The finding that the effects of entering specialized fields of 
study are greater, if anything, upon student press for science than upon 
the two marker variables (faculty press for science or humanities) is 
reminiscent of Co P. Snow’s (43) thesis that there is little communica- 
tion between the two cultures — that of the scientists and that of the 
literary intellectuals » Thus the effects of majoring in physics or 
chemistry, the health professions, the biological sciences, or engineer- 
ing are to increase the frequency with which students say that the 
following statements are characteristic of the peers they knew best: 
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TABLE 16 

Adjusted Mean Scores on Student Press Scales of 655 Men in 14 Fields of Study 
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"they talked frequently about the philosophy and methods of science"; 
"most of my friends had strong interests in science and mathematics"; 
"most of them were planning careers in science.," Since two-thirds 
of the respondents said that most of the students they were describ- 
ing were not in their own major field of study? it appears that one 
consequence of majoring in one of these fields is to increase the 
frequency with which one associates with students in other physical 
sciences. The results obtained on the scale? student press for es- 
theticism? suggests that proselytes to one of the disciplines within 
the humanistic tradition exhibit a similar? if less marked? tendency 
to associate mainly with majors in other humanistic fields. Thus? 
among both men and women those majoring in fine and applied arts 
showed greater increments in student press for estheticism than those 
majoring in the health professions (Tables 15 and 16), 

There was also evidence of field effects on the scale? Student 
Press for Advanced Training: among men entry into physics or chem- 

istry? the health professions? and the biological sciences was 
accompanied by relative increases in press for advanced training? 
while entry into fine and applied arts? business administration? or 
education was associated with relative decreases in such press. Sim- 
ilarly? there were greater increments in student press for reflective- 
ness reported among men majoring in the health professions tnan among 
those majoring in fine and applied arts or education (Table 16). 

Two other borderline effects upon student press were found among 
men: entry into the health professions was associated with a greater 

increment in student opposition to faculty influence than entry into 
education; and entry into physics or chemistry was associated with a 
greater increment in student press for vocationalism than entry into 
the health professions. No significant field effects were found with 
respect to changes in the following types of student press: academic 

achievement? affluence? intellectualism? playfulness? and unfavorable 
self evaluations. 

Restriction in the gene raliz ability of the findings . In dis- 
cussing quasi— experimental designs? Campbell and Stanley (13) note 
that an "interaction of selection and maturation" may frequently be 
mistaken for a treatment effect; such an interaction may also be 
interpreted as a restriction of the possible generality of experimental 
effects. For example? suppose that engineering students tend to spe- 
cialize in engineering courses almost as much during the freshman and 
sophomore years as they do during the junior and senior years. In 
contrast? suppose that psychology majors follow a much more widely 
distributed course of study during the initial years? and tend to 
specialize in psychology courses only during the last two years of 
college. By administering the pretest at the completion of the sopho- 
more year and the posttest at the end of the senior year of college? 
one may be comparing the effects upon engineering students during a 
period of relatively little change with effects upon psychology stu- 
dents during a period of marked ecological change. To the extent that 
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prospective majors in any of the fields compared tended to specialize 
in their major fields during the initial college years? it would be 
improper to interpret the present procedures as yielding estimates of 
the total effects of entering a field of study. This follows because 
under the given hypothetical conditions removing field differences on 
the covariable at the end of the sophomore year partials out some of 
the very effects to be assessed. Clearly? the present analysis yields 
information only about the effects of entering a field of study during 
the last two years of college . However? the fact that the pattern of 
results on the two marker variables agreed closely with expectations 
suggests that the results may also be a reasonably good approximation 
to the results one would find if the pretest had been administered 
near the beginning of college. 

Alternative Methods of Assessing Effects 

In this section we shall summarize the results of several addi- 
tional methodological analyses. The major purpose of these investi- 
gations was to ascertain whether there were conditions under which 
alternative methods might be used appropriately in analyzing effects 
upon variables for which pretest reliability measures were not avail- 
able. In each case? the criterion for the fidelity with which a mode 
of analysis estimated effects was the degree of agreement with the 
true-score covariance analysis on the variables just considered. In 
other words? if an alternative mode of analysis can be shown? at 
least under some known conditions? to appropriately reflect these 
effects? then we may have some confidence in 'ising this method to 
analyze effects upon other dependent variables. 

Increases in tre atment-ou tcome correlations , Campbell and 
Clayton (12) suggested that one symptom of causal effects in panel 
data is an increased correlation? from pretest to posttest? between 
dependent and independent variables, Campbell (personal communication) 
has recently called this symptom an "increase in treatment-outcome 
correlation," Such a condition would exist? for example? if the classi- 
fication by treatment groups accounted for a greater proportion of the 
variance in posttest scores than of the variance in pretest scores. An 
appropriate index of change in the tre atment-ou tcome correlation might 
be the difference in Omega-squared estimates based upon pretest analysis 
of variance and upon posttest analysis of variance (22? p. 382). If the 
estimate of Omega-square is greater for the latter than the former then 
an increase in the treatment-outcome correlation has occurred. 

Conventional analyses of variance were performed on the pretest and 
posttest scores on each of the 23 college press scales to obtain esti- 
mates of the proportion of pretest and posttest variance associated with 
the classification by major field of study; these results were then com- 
pared with the results from the true-score covariance analyses just 
considered. 

Tables 17 and 18 show comparisons for each scale having an overall 
covariance F-ratio significant at the ,01 level? either when true pretest 
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TABLE 17 



Comparisons of Covariance Analyses Using as the Covariable 
Fallible and True Pretest Scores of 655 Men in 14 Fields 



College 
Press Scale 


based 
on ANOVA 
of 

Reli- Pre- Post- 
ability test test 

(1) (2) (3) 


Depen 

dent 

Var, 

(4) 


ANCOVA based upon 

Fallible True 

Pretest Pretest 

Scores Scores 

J—CJ^ 1 

(5) (6) (7) (8) 


Correl- 

lation 

be- 

tween 

adj. 

means 

(N=14) 

(9) 






I. Faculty 


Press 


Scales 










Science 


.59 


.14 


.19 


1 


6.06** 


.09 


2.57** 


.03 


.958 








.25 


2 


9.76** 


.15 


4.84** 


.07 


.973 


Humanities 


.80 


.13 


.19 


1 


5.87** 


.09 


4.05** 


. 06 


.995 








.18 


2 


5,05** 


.07 


3.33** 


.04 


.997 


Adv. Trng. 


.72 


,00 


.04 


2 


2.45** 


,03 


2.17** 


.02 


.994 


Vocationalism 


.76 


.08 


.10 


1 


2.78** 


.03 


1.77* 


.02 


.974 








.13 


2 


4. 78** 


.07 


3.64** 


.05 


.981 


Enthusiasm 


.71 


.05 


. 06 


1 


2.25** 


.02 


1.59 


,01 


.989 




II. Student 


Press 


Scales 










Science 


,88 


.17 


.26 


1 


8.00** 


.12 


5.77** 


.09 


,998 








.25 


2 


7.35** 


.11 


5.39** 


.08 


.996 


Adv, Trng. 


.74 


.04 


,11 


1 


4.61** 


.07 


3.13** 


.04 


.988 








.09 


2 


3.97** 


. 06 


3.12** 


.04 


.995 


Estheticism 


.88 


.05 


.07 


2 


2.40** 


.03 


1.94* 


.02 


.994 


Reflectiveness 


,89 


.02 


.03 


2 


2.31** 


.03 


2.24** 


.02 


.995 


Vocationalism 


. 56 


.09 


.08 


2 


2.44** 


.03 


1.93* 


.02 


,452 



*p < . 05 

**p<o01 
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scores or fallible pretest scores were used as the covariable. The 
relevant comparisons in each of these tables ^may be found under columns 
2, 3, and 7. The entries for the first row for the Faculty Press for 
Science scale in Table 17 show that there was an increment in the 
treatment-outcome correlation; for example, from cols. 2 and 3 we learn 
that the proportion of variance associated with the treatment classi i- 
cation increased from .14 to .19 from the pretest to the posttest. 

Table 17 also shows that a significant F-ratio of 2.57 was obtained 
(col 7 ) from the covariance analysis using Porter’s method. An in- 
spection of these tables will reveal that on every scale except two 
(Student Press for Vocationalism in Table 17 and Student Press tor 
Estheticism in Table 18) a significant F-ratio for the true-score 
covariance analysis was accompanied by an increase in the treatment 
outcome correlation. Perhaps the most informative comparison, however, 
is the correlation between the difference in Omega-square values and 
the true-score F-ratio for the entire set of 23 press variables. For 
the one-year interval, the correlations were .90 and .87 for men and 
women, respectively, while for the two-year interval the correlations 
were .90 and .79 for men and women, respectively. It may be concluded 
that the criterion of an increment in the treatment- outcome correlation 
has moderate validity as a symptom of causal effects, but it is also 
clear that differential treatment effects may occur without resulting 
in an increased treatment-outcome correlation. 



Conventional analysis of covariance . The second alternative mode 
of analysis investigated was conventional analysis of covariance in 
which fallible (rather than true) pretest scores were used as the co- 
variate. Such analyses were performed for each of the 23 college press 
scales. For each type of covariance analysis (true-score and tallible; 
estimates of the proportion of variance in the adjusted scores associated 
with the major field classification were obtained by calculating Omega- 
squared values by an adaptation of the procedures described by Hays (2^, 
pp. 381-384). Finally, the adjusted means obtained from each type ot 

analysis were correlated. 



Comparisons between the two types of covariance analyses are 
summarized in columns 5 through 9 in Tables 17 and 18. In general, t e 
F-ratios and Omega-squared values obtained from the conventional co- 
variance analyses were spuriously large. This was particularly true 
when the pretest had a relatively low reliability and there was a 
large Omega-squared value for the analysis of variance of pretest scores. 
The latter, of course, is a direct indicant of the fact that fields ^ " 
fered markedly on the pretest. For example, in Table 17 it is clear that 
the largest discrepancies between the F-ratios for fallible and true- 
score analyses occurred on the scale. Faculty Press for Science. Cols. 

5 and 6 indicate that on this scale the fallible covariance analysis for 
1967 posttest scores yielded an F-ratio of 9.76, and 15 per cent the 
variance in the adjusted scores was associated with the field classifi- 
cation; in contrast, cols. 7 and 8 indicate that the true-score covari- 
ance analysis yielded an F-ratio of only 4.84, and orily ? 

the variance in the adjusted scores was associated with the field classi- 
fication. Also, it can be seen that this scale had a pretest reliability 
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TABLE 18 



Comparisons of Covariance Analyses Using as the Covariable 
Fallible and True Pretest Scores of 523 Women in 11 Fields 













Correl 




based 
on ANOVA 




ANCOVA 


based on 


lation 

be- 

tween 






Fallible 


True 




of 


Depen- 


Pretest 


Pretest 


ad j . 




Reli- Pre- Post- 


dent 


Scores 


Scores _ 


m© Qiis 


College 
Press Scale 


ability test test 

(1) (2) (3) 


Var. 

(4) 


F CJ 

(5) (6) 


F U 

(7) (8) 


(N=ii) 

(9) 



I. Faculty Press Scales 



Science 


00 

• 


,09 


,18 


2 


7.93** 


.12 


3.32** 


,04 


.962 


Humanities 


.75 


,14 


,19 


1 


6,72** 


.10 


4.78** 


.07 


.995 








,17 


2 


6.35** 


.09 


4.80** 


.07 


.993 


Adv, Trng, 


CO 

o 


.01 


CO 

o 

• 


2 


2.64** 


CO 

o 

• 


2.57** 


CO 

o 

• 


.893 


Vocationalism 


.74 


,07 


.13 


1 


5.34** 


• 

o 

00 


3, 89** 


.05 


.993 








,13 


2 


5,06** 


o 

o 


3.71** 


,05 


.995 




• 

1— 1 
1— 1 


Student Press 


; Scales 










Science 


o 

00 


00 

O 

• 


,15 


2 


5,22** 


.07 


3,95** 


.05 


.996 


Estheticism 


• 

00 

Cn 


• 

H 

o 


o 

H 

o 


2 


'2.47** 


CO 

o 

• 


1.82* 


.02 


,957 



*p<.05 

**p<,01 



of only .59 5 and 14 per cent of the variance in pretest scores was 
associated with the classification by major field of study. Among 
women, the largest discrepancies in the overall F-ratios from the two 
types of analyses also occurred on the scale. Faculty Press for Science, 
and under similar conditions of low scale reliability and sizeable field 
differences on the pretest (Table 18). 

The correlations in col, 9 of Tables 17 and 18 show that there was 
a very substantial correspondence in the adjusted means derived from the 
fallible and true-score analyses. Appreciable discrepancies in adjusted 
means for men occurred only on the scale. Student Press for Vocationalism 
(Table 17), where the two sets of adjusted means had a correlation of only 
,452 (not significant with an N of 14), Table 17 also shows that this 
scale had the lowest pretest reliability (,56) among men, and that 9 per 
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cent of the variance in pretest scores was associated with the field 
classificationo More pertinent, however, is the observation that there 
was a decrease in the Omega-squared value from the pretest to^the post- 
test („09 vso o08)o Among women, the press scale having the lowest 
pretest reliability (o48) was the scale. Faculty Press for Science. Table 
18 shows that although this scale revealed both low reliability and size- 
able field differences on the pretest, the adjusted means from the fallible 
and true-score analyses had a correlation of .962o It may be noted, how- 
ever, that on this scale there was a marked increase in the Omega-square 
values from the pretest to the posttest ( » 09 vs <> ..18) . 

To summarize, for most of the dependent variables analyzed the 
overall F-ratio provided by the conventional analysis of covariance (which 
ignores errors of meas’irement in the covariable) leads to spuriously high 
significance levels. Nonetheless, Tables 17 and 18 show that there is 
considerable correspondence between the fallible and true score analyses. 
Thus every overall F-ratio, save one, from the fallible covariance analyses 
which was significant at the .01 level had a corresponding F-ratio in t e 
true-score analyses significant at the .05 level or higher. These results 
suggest that conventional covariance analyses of quasi-experimental data 
in which the treatment classification accounts for 3 per cent or more o 
the variance in the adjusted scores may provide fairly robust, though 
slightly inflated, overall estimates of the significance levels which ^ 
would be obtained with appropriate correction for measurement errors in^ 
the covariable c However, one caution suggested by the present results is 
that adjusted means derived from conventional covariance analyses in 
which there is a decrement in the treatment-outcome correlation may be^ 
seriously misleading. More specifically, these results suggest that the 
rank-order of adjusted means from fallible analyses are likely to be 
inaccurate when there is a decrement in the treatment-outcome correlation, 
but the adjusted means from such conventional covariance analyses may be 
reasonably accurate when there is a marked increase in the treatment- 
outcome correlation. In Appendix D, an analysis is presented which ex- 
plains why this is likely to be the case. 

The method of contrasting pa ired- treatment and internal regressions . 
The te^nique of comparing fallible and true-score analyses may also be 
applied to the examination of individual pairs of adjusted means, just as 
it was applied to the overall significance test of covariance analysis in 
the preceding section. When this is done it can be shown that even more 
precise statements can be made about the conditions under wbi^ conventional 
covariance analyses yield non-spurious estimates of effects in quasi- 
experiments. A hypothetical example may illustrate the kinds of conclu- 
sions we may be able to draw for particular pairs of treatment groups. 

Suppose that we have 3 treatment groups (A, B, and C) in a quasi- 
experiment with appropriate measures on a pretest (X) and on a posttest 
(Y). Suppose further that the observed (common) within-group regression 
of Y on X has a slope of .4, while the regression of Y on estimated true 
scores on X has a slope of 1.0; and that during the interval between pre- 
test and posttest the means for group A increase from 1.0 to 4.0, those 
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for oroup B increase from 5.0 to 7.0, and those for group Cdecrease 
from".0 to 2.5. Figure 1 shows the three groups with the s 

and posttest means, and with the assumed fallible (s°lid> “ ? ^ 

and true-score regressions (dashed, diagonal lines). The progections 
shown on the Y-axis indicate that the conventional covariance analysi 
S yLld adjusted means of 5.2, 6.6, and l-V.^while the t^e-score 
covariance analysis would yield adjusted means Ox 7o0, 6.0, and .5, f r 
groups A, B, and C, respoctivelyo 

Consider first the statements we might make concerning the differ- 
ential effectiveness of treatments A and B. The fallible covariance 
analysis indicates that B produced a greater positive increment in scores 
thS irwMle the true-scoL analysis indicates that A produced a greater 
positive increment in scores than B. Clearly, for this pair o re 
ments the conventional covariance analysis is misleading. 

However, a somewhat different picture emerges when we consider the 
differ^tlal’ effectiveness of A vs C or_B vs. C. The toe-score analy- 
sis indicates that treatment A tends to increase scores more than treat 
ment C, and the fallible analysis yields the same conclusi^ together 
with a conservative estimate of the effect (estimated treatment differ- 
ent of 6.5 and 3.5, respectively). Similarly, the true-score analysis 
indicates that treatment B tends to increase scores more than treatment 
C7and the fallible analysis yields the same conclusion and a conserva- 
tive estimate of the effect (treatment differences of 5.5 and- .. , 
respectively). 

Clearly it would ue useful to have a general formulation which would 
enable us to predict when the correspondence between fallible 

score analyses resembles the latter pattern 7 a R') 

or B vs. C), rather than the former pattern (that illustrated by A vs. B) 
Annendix D develops such a formulation and summarizes corroborative empir 
icL tests of it/ Only that portion of the formulation dealing with posi 
tive within-group regressions will be outlined here. 

The criteria for determining whether conventional covariance analy- 
sis leads to spurious, or to directionally correct and conservative, 
estimates of differential treatment effects are as follows. 

(a) If the observed within-group regression is positive, and the 
line connecting the points representing the pair of treatmen 
means to be compared (e.g., A and B in Figure l) has a slope 
algebraically greater than the within-group slope, then 
comparison of the two adjusted means will yield a potentially 
spurious estimate of differential effects. 

(b) If the observed within-group regression is positive, and the 

line connecting the points representing the pair of treatmen 
means to be compared (e.g., A and C or B ^^d C in Figure ) 
has a slope a3 gebraically less than the within-group slope, 
then the comparison of the two adjusted means wil 77 ^ 

directionally correct and conservative estimate of differential 

effects. 
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POSTTEST SCOP.E (Y) 




PRETEST SCORE (X) 



Figo lo Hypothetical Outcomes of Fallible and True-Score Covari- 
ance Analyses of Scores for Three Treatment Groups 



39 



Although on first reading these criteria may appear arbitrary? they can 
be shown to be both reasonable and consistent with empirical tests o For 
example? considering the A vs. C comparison? we may note that group C 
had a higher pretest score than group A? while group A had a higher 
posttest score than group C, Clearly during the interval between pretest 
and posttest scores have increased for group A and decreased for group C., 
The conclusion that treatment A increases scores more than treatment C 
is therefore reasonable. A more detailed examination of the rationale 
for? and the highly corroborative empirical tests supporting? this for- 
mulation is presented in Appendix D, 

The importance of these criteria is that on the basis of bivariate 
plots like those shown in Figure 1 it is possible to identify pairs of 
treatments for which conventional covariance adjustments provide direc- 
tionally correct but conservative estimates of differential effects. 

In the next section? this technique is used to describe additional 
effects of entering a field of study on variables for which reliability 
estimates were not available. 

Field Effects upon Student Aspirations and Values 

In considering effects upon variables for which reliability esti- 
mates were not available? the following strategy was employed. The 
overall significance test provided by conventional analysis of covari- 
ance was inspected? and if this ratio did not meet the .05 significance 
level the relevant hypothesis was regarded as rejected. If the given 
F-ratio met or exceeded this level? further comparisons were made only 



4he proposed criteria are in fact a generalization of the principle 
of contrasting internal and external regressions when there are but two 
treatment groups. To the writer’s knowledge no one has previously 
suggested the particular formula :ion proposed here? although there has 
been ample discussion of tests for the difference in the internal and 
external regression slopes. Cochran (14)? Smith (42)? and Winer (58) 
present alternative techniques for testing the significance of the differ- 
ence between external and internal regressions in the analysis of covari- 
ance. However? Smith notes that in most texts on statistics interpreta- 
tion of the internal versus external regression ”is usually side stepped 
or at best controversial?” and indicates that better examples are needed 
in order to clarify this analytic model (42? p.302). More recently? 

Porter (365 p» 13-15) independently described six hypothetical cases 
(all with positive within-group regressions) in which treatment means 
have varying types of juxtaposition? and showed how correspondence between 
true-score and conventional covariance adjustments varied by type of juxta- 
position. It can be shown that the criteria described in Appendix D are a 
more general formulation of the cases described by Porter. 
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between the members of pairs of treatments meeting the regression cri- 
teria outlined in the preceding section^ Among the latter, differential 
effects were inferred only for those treatment pairs yielding significant 
F-ratios for testing the significance of the difference in adjusted means. 
Although this procedure yielded a conservative test of differential field 
effects (cf. Appendix D), it has the advantage of ruling out spurious 
effects arising from errors of measurement on the covariable « 

Aspiration 0 The aspiration variables were based upon responses to 
a question, included in each of the annual surveys, asking the student 
to indicate the highest level of education he expected to complete by 
choosing among the following categories: (a) I expect to complete three 

years of college; (b) I expect to get a bachelor’s degree; (c) I expect 
to do some graduate study but not enough for an advanced degree; (d) I 
expect to get a Master’s degree; (e) I expect to obtain a first- 
professional degree (M.D., D.D.S., L.LoBo, or B,D); or (f) I expect to 
obtain a PhoD. or other equivalent academic doctorate degree. The last 
two categories were regarded as representing roughly equivalent levels 
of education and were each was assigned the numerical value of 5, while 
categories a, b, c, and d were assigned the values of 1, 2, 3, and 4, 
respectively. The student’s 1965 response yielded a pretest score, used 
as covariate, and his 1966 and 1967 responses yielded posttest scores, 
which were used as dependent variables; treatment groups consisted of 
fields of study as defined in the preceding sections o 

Among women, neither the overall F-ratio for one-year changes (F 
= .98) nor that for two-year changes (F = .69) was significant, and the 
hypothesis that there were field effects upon the aspirations of women 
was rejected. 

Among men, there was an F-ratio significant at the .01 level of 
confidence both for one-year (F = 3.05), and for two-year (F = 3.50), 
changes in aspirations. However, as we have already seen in Tables 17 
and 18, these overall F-ratios may be spuriously inflated. When addi- 
tional comparisons were made, in each analysis, between the pairs of 
adjusted means meeting the regression criteria described in the pre- 
ceding section, none of the latter treatment pairs were found to differ 
significantly. Accordingly, the hypothesis of differential field 
effects upon the aspirations of men was rejected. 

Student values . Four student value variables were defined on the 
basis of the respondent’s ratings, on each of the annual surveys, of 
the importance of 12 of 13 requirements for a satisfying job or career. 

The variables, together with the requirements associated with each, 
were as follows : 

1. Prosocial orientation — ’’provide me an opportunity to work on 
the application of knowledge to practical affairs,” ’’give me 
opportunities to work with people rather than things,” ’’give 
me an opportunity to be helpful to others,” 
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2„ Affluence orie ntation — ’’provide me with a chance to earn a 
good deal of money?” ’’give me social status and prestige?’ 
’’enable me to look forward to a stable? secure future o 

3. Intellectual orientation — ’’give me an opportunity to live and 
work in the world of ideas?” ’’provide me an opportunity to work 
on theoretical problems regardless of practical value? ’’permit 
me to be creative and originali’ 

4 Individualistic orientation — ’’leave me relatively free of 

supervision by others?” ’’give me a chance to exercise leader- 
ship?” ’’provide me with adventures” 

Tables 19 and 20 summarize for men and women? respectively? all of 
the statistically significant comparisons between adjusted mean value 
scores that were non-spurious by the criteria described.^ In these ^ 
tables a low adjusted mean indicates a relatively large increment in the 
given valueT Field effects upon the prosocial orientations of men were 
as follows: health professions produced a greater increment than either 

fine and applied art or English; and history a greater increment than 
fine and applied art (Table 19), With respect to effects upon the 
affluence orientations of men? entry into engineering produced greater 
increments than entry into either fine and applied art or Englis 
Finally? majoring in history produced a greater increment in indivi- 
dualistic orientations than majoring in English. 

Among women? entry into nursing training (health professions) pro- 
duced a greater increment in prosocial orientations than entry into 
English, Sociology majors exhibited greater increases in affluence 
orientations than majors in fine and applied art. Virtually al o e 
remaining differences in Table 20 involved women selecting mathematics 
as their major field: these women exhibited smaller increments in 

intellectual orientations than women specializing in education? modern 
foreign languages? fine and applied art? or biological sciences? and 
they showed smaller increments in individualistic orientations than 
women majoring in biological sciences? English? or fine nn app le ar 
Finally? majors in modern foreign languages exhibited greater incre-^ 
ments in individualism than women selecting nursing as their major field 

Are there Plausible Rival Explanations of the Results ? 

It is apparent that the analytic methods used in these quasi- 
experimental tests of hypotheses cannot? and did not? take account of 



^The foregoing clusters of requirements were defined on the basis 
of an inspection of the correlations between ratings of requirements in 
1965, One requirement — ’’provided me with an opportunity to use 
special abilities and aptitude”— was rated important by virtually all 
students and was omitted from the analysis. 
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TABLE 19 



Comparisons of Adjusted Mean Value Scores for Treatment Pairs 
in v/hich Covariance Analysis is Non-Spurious (Men) 



Variable 


Year 

posttest 

scores 

were 

obtained 


Treatment Adjusted 

pair posttest 

compared scores^ 


Diff. 


F 

(df = 
1,640) 


Prosocial 

orientation 


1966 


Health professions 
Fine, applied arts 


5.12 

6.78 


1.66 


9.37** 






History 

Fine, applied arts 


5.91 

6.78 


.87 


8.08** 






Health professions 
English 


5.12 

6.46 


1.34 


6.79** 


Affluence 

orientation 


1966 


Engineering 
Fine, applied arts 


4.91 

5.53 


.62 


3.39* 






Engineering 

English 


4.91 

5.42 


.51 


3.39* 


Individualistic 

orientation 


1966 


History 

English 


5.45 

6.31 


.86 


9.46** 



^Lower adjusted means indicate greater increments in the given 
value , 



*p <.05 

**p <»01 

all possible antecedent differences between treatment groups. It may 
therefore appear that there are numerous plausible rival explanations 
for the results. Cochran (14), Lord (31), and Stanley (44), whose 
discussions dealt mainly with observational studies, noted that even 
though we adjust groups for differences on a covariabl^ bias may be 
present from some disturbing variable that was overlooked. However, 
merely to assert that such a contingency is possible in quasi- 
experimental comparisons does not necessarily invalidate the covari- 
ance test of the hypothesis that "treatments" have had differential 
effects. In order to regard group differences on an overlooked ante- 
cedent variable as a plausible rival hypothesis, it seems necessary 
to show that such groups do indeed differ with respect to one or more 
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TABLE 20 



Comparisons of Adjusted Mean Value Scores for Treatment Pairs 
in which Covariance Analysis is Non-Spurious (Women) 



Variable 


Year 

posttest 

scores 

were 

obtained 


Treatment 

pair 

compared 


Adjusted 

posttest 

scores® 


Biff. 


F 

(df = 
1,511) 


Prosocial 

orientation 


1966 


Health professions 
English 


6.15 

6.72 


.57 


5.84* 


Affluence 
or~ entation 


1966 


Sociology 

Fine? applied arts 


4.33 

4.89 


.56 


3.54* 


Intellectual 

orientation 


1967 


Education 

Math , 5 statistics 


5.62 

6.38 


.76 


7.50** 






Mod. for, lang. 
Math., statistics 


5.65 

6.38 


.73 


5.85* 






Fine, applied arts 
Math., statistics 


5.69 

6.38 


.69 


5.22* 






Biological sciences 5,72 
Math., statistics 6.38 


. 66 


4.14* 


Individualistic 

orientation 


1967 


Biological sciences 5.69 
Math,, statistics 6.75 


1.06 


8 . 01** 






Mod, for, lang. 
Health professions 


5.56 

6.28 


.72 


4.98* 






English 

Math,, statistics 


6.10 

6.75 


.65 


4.11* 






Fine, applied arts 
Math,, statistics 


6.06 

6.75 


.69 


3.88* 



^Lower adjusted means indicate greater increments in the given 
value 0 



*p < » 05 

**P < o 01 



44 



specific antecedent variables, and that such differences can plausibly 
account for the alleged treatment effects* In other words, the mere 
theoretical possibility that one or more rival explanations of the 
results may be found would not invalidate the covariance tests reported. 
In contrast, the demonstration that one of these potential rival ex- 
planations is plausible would invalidate such a test. Whether there 
are in fact any such plausible rival explanations for these treatment 
effects is an empirical question that can and should be investigated* 

While we cannot rule out the possibility that one or more plau- 
sible rival explanations may eventually be discovered, it should be 
emphasized that there is no evidence that the proposed causal inter- 
pretations have any serious rival* Both the true-score covariance 
analyses and the clear confirmation of expected effects upon the 
"marker variables," faculty press for science and faculty press for 
humanities, lend considerable credence to these causal interpretations. 

Conclusions 



Partly as a consequence of the decision to enter a field of study 
the student is exposed to particular types of faculty and student press. 
The most striking differentiation in college press occurred between 
students majoring in the physical sciences, on the one hand, and those 
majoring in the humanities, on the other* Students in these two sub- 
cultures not only described the teachers they knew best in markedly 
different terms; they also described their close undergraduate friends 
very differently. The results confirm in part the development of the 
"two cultures" — scientific and humanistic — which C. P. Snow described 
some years ago* There was no evidence that entering a field of study 
had effects upon aspirations to seek advanced graduate or professional 
degrees. However, there was evidence that entering a field of study 
sometimes affects the student’s values — particularly, his prosocial, 
affluence, intellectual, or individualistic values. 

A series of methodological analyses demonstrated that it is 
possible to formulate specific conditions under which conventional 
covariance analysis yields non-spurious estimates of effects in quasi- 
experiments* 
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CHAPTER IV 



CHANGES IN STUDENTS AND IN COLLEGE ENVIRONMENTS 

Do students change, on the average, as they progress through college? 
DO th”; come to adopt\igher aspirations, and 

chanee’ Do they become more or less t'mogeneous? At the same time, do 
student oerceptlons of the teachers and peers they know best change. If 
so" what^kSdfof teacher and student press are stable in their level, and 
whk kinds increase or decrease in level? Do students perceptions of 
their teachers and peers become more or less homogeneous with increased 

exposure to college? 

These and similar questions are concerned with effects, or 
correlates, of an independent variable which may be called lengt 
exposure to college," If exposure to college affects some dependen 
TlTahle Sdicative of the student’s plans, values, or ecology, then one 
would expect to be able to demonstrate that either the central tendency, 
vS^ility, of scores on that variable vary with length of ex- 
posure to college. In this chapter, we shall be concerned with a simi 
lar independent variable-length of exposure to ujpercl^ss college en- 
vironments. In the course of this analysis we shall 

every questionnaire item or scale which was administered without changes 
In iLtructions or content on each of the three survey occasions. 

in general, one might expect the analysis of changes i"^he vari- 
ability of measures over the college years to corroborate the covariance 
analysis presented in Chapter III. In contrast, one might anticipate 
that the Lalysis of changes in mean levels on g®® 

be sensitive to additional college effects not revealed by an^ly® 

In the preceding chapter. These expectations may be clarified by the 
lllustrrtion in FiguL 2. In Part I of this figure average sc^es on a 
dependent variable for students entering two hypothetical treatmen s 
(■fields), A and B, are shown, with outcomes suggesting that treatmen 
produced an Increment, and treatment B a decrement, in scores on e 
given variable. The covariance procedures we have considered i" the 
preceding chapter would probably suggest differential effects 
cases, and coLarlsons of the variabilities of the ove^ll pretest and 
postt^st scores (for example, pooling subjects in treatments A and B) 
should reveal that the latter is greater than the former. If 

sldS the case illustrated in Part II of this figure we see that the 
test results yielded by (a) covariance analysis and (b) the criterion 
of an "IncremLt in pooled variances" will not be congruent when there 
is a decrement in the treatment-outcome correlation: the foraer would 

TffLm! and the latter deny, a causal effect in this case. However, 



il am indebted to Campbell and Clayton (12) and to Donald _T. 
Campbell (personal communication) who first suggested a an increme 
in pooled variance may be one additional symptom of causal effects. 
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to the extent that increments in treatment- outcome correlations are 
the rule (and decrements the exception) one might expect to find 
generally that whenever treatment effects are demonstrable on a given 
variable by overall F-ratios from covariance analysis, there is a 
parallel increment in the pooled variance of scores from pretest to 
posttesto In contrast, in the case illustrated in Part III of Figure 
2 we assume that there is no change in the pooled variances from pre- 
test to posttest and no effects that would be diagnosed by covariance 
methods, though there is a marked elevation in score levels from pre- 
test to posttesto The latter outcome suggests that exposure l^^what- 
ever it was that intervened between pretest and posttest may be pro- 
duced elevated scores in both groups » In other words, colleges may 
have effects upon students which do not vary appreciably by field of 
study o To be sure, comparisons of the pretest and posttest means for 
the pooled groups would not tell us what specific factors occurred 
within the pretest-posttest interval to produce the effects. None- 
theless it is clear that a method of detecting changes in average 
scores of panel members may suggest complex causal effects not re- 
vealed in the earlier covariance analyses (which were concerned solely 
with identifying differential field effects). 

The purpose of this chapter is twofold: first, it seeks to 

evaluate the validity of the criterion of an increment in pooled 
variance as a symptom of experimental effects; second, it seeks to 
cas4r a wider net for capturing potential college effects. With res- 
pect to the latter, we would like to identify changes which college 
students exhibit, regardless of whether all of these changes can be 
shown to be the consequences of exposure to college. In Chapter V we 
shall consider an additional type of analysis designed to identify 
more specific kinds of experiences that may cause changes in disposi- 
tions to seek advanced graduate or professional training. 

Changes ini Variabilities dni Student and College Measures 

We have already seen that — given the rule that there is usually an 
increment in the treatment-outcome correlation— there is some reason to 
believe that changes in overall variabilities on the student and college 
measures will reflect roughly the same kinds of changes already dis- 
cussed in Chapter III. The methodological analysis evaluating the 
validity of an increment in pooled variance as an indicant of causal 
effects is considered first, and next the substantive results of 
changes in the homogeneity of students or of their environments are 
discussed. 

Increment in pooled variance as a criterion of causal effects . On 
each college pre^s scale the differences in the standard deviations of 
the scores obtained by all 655 men on the pretest and on each of the 
posttests was calculated. Similar differences were calculated for the 
523 women. Differences using the 1966 posttest scores refer to differ- 
ences over a one-year interval, while those using the 1967 posttest scores 
refer to differences over a two-year interval. For each sex and for each 
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interval, these differences were correlated with the F~ratios obtained 
from the true-score covariance analyses described in the preceding 
chapter., Table 21 summarizes the obtained correlations, and compares 
them with those obtained when the latter F~ratios were correlated with 
increments in treatment-outcome correlations and with F-ratios from the 
fallible covariance analyses discussed in Chapter III. It can be seen 
that expectations concerning the validity of the criterion of an incre- 
ment in pooled variance were unconfirmed^ The latter criterion was 
decidedly poorer than either of the other two criteria shown in Table 21 » 

TABLE 21 

Comparisons between Alternative Criteria of Causal Effects 



Correlation of given criterion with F-ratio 
from true-score analysis of covariance^ 





Men 




Women 




Criterion 


One- 

year 


Two- 

year 


One- 

year 


Two- 

year 


Increment in pooled variance 


.25 


I 

o 

O 

GO 


CO 

o 

0 

1 


.44 


Increment in treatment-outcome 


correlation 


.90 


.90 


.87 


.79 


F-ratio from fallible analysis 


of covariance 


.94 


.95 


.96 


.91 


^Correlations are based on 


an N of 23, 


since 


outcomes were 


compared 



on each of the college press variables. 

How can these results be explained? In the case illustrated in 
Part I of Figure 2 the expectations were based upon a number of assump- 
tions, and it is possible that one (or more) of these assumptions was 
not satisfied. First, as we pointed out, the logic of using an incre- 
ment in pooled variance as a symptom of causal effects assumes that 
there is an increment in the treatment-outcome correlation^ Second, it 
was implicitly assumed that the average within-group variability would 
be relatively constant from pretest to posttest. More particularly, it 
was assumed that the variabilities of pretest and posttest scores with- 
in extreme-scoring treatments would be relatively constant. Suppose, 
for example, that treatment A in Part I of Figure 2 (or more generally, 
the treatment groups tending to score highest on both the pretest and 
the posttest) manifested a decrease in within-group variability from 
pretest to posttest . Suppose also that treatment group B (or treatment 
groups tending to score lowest on both pretest and posttest) manifested 
a decline in variability of scores from the initial to the final test. 
The results would then be that the criterion of an increment in pooled 
variance would not be a sensitive indicant of treatment effects. 
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To ascertain whether failure to satisfy t& second assumption 
played any part in the poor performance of the iWiance criterion, th\^ 
scores of student\, in extreme -scoring fields of 4tudy were examined on\ 
two scales, each M which yielded a significant F'^*atio in the true-s«cd^e 
covariance analysis! and yet manifested decrements pooled variance froliri 
pretest to posttest On each of these scales a s inkle field tended to be\ 
the highest-scoring ‘l^ield on both the pretest and th||Xposttest, while a 
different field was tl,e lowest- scoring on both pretestVand posttest. As 
expected, on each scal\ the high-scoring and low-scoriri^. fields had lower 
variabilities on the posttest than on the pretest. For l^ample, on the 
scale for assessing faculty press for advanced training md^n majoring in 
chemistry or physics were high-scoring both in 1965 and in 1967, and 
during this interval the standard deviation of their scores decreased 
frpm 4.39 to 3.49, while the standard deviation of scores of men ill fine 
an! applied arts — the lowest-scoring field — decreased from 5.33 to 3.49 
during the same interval. Similarly, on the scale for assessing student 
press for estheticism, women majoring in fine and applied arts were the 
highest-scoring group both in 1965 and 1967, and the standard deviation 
of their scores decreased from 4.47 to 4.13 during this interval, while 
the standard deviation of scores of women taking nursing — the lowest- 
scoring field. on both occasions — decreased from 4.39 to 3,95 during this 
interval. In other words, students in these extreme-scoring fields 
tended to report a more homogeneous press for their senior year in 
college than for their sophomore year in college. Such effects are, of 
course, to be expected as the student specializes more and more in his 
field of study. However, the latter tendency will cause havoc for the 
criterion of pooled variance whenever particular treatment groups tend 
to be extreme in a given direction on both the pretest and posttest. In 
any case, it was concluded that the criterion of an increment in pooled 
variance was not a dependable symptom of differential field effects. 

One implication of this conclusion is that one would not expect changes 
in variabilities of student scores to provide a simple replication of 
the field effects discussed in Chapter III. 

Changes in homogeneity on student measures . Scales for assessing 
degree aspirations and intellectual orientations were the only two 
measures of studentf aspirations and values which revealed statistically 
significant changes in the variability of scores from the pretest to the 
posttest. Responses to the degree aspiration question were scored in 
the manner described in the preceding chapter. Among men, there was a 
decrease in the standard deviation of aspiration scores from_ 1.09 to .90 
over the two-year interval (t = 6.03, p<.0l), while among women there 
was a decrease from 1.03 to .83 over the same interval (t = 5.95, p^.Ol) 
As we shall see in a later section, these changes were accompanied by 
increments in average aspiration levels, and the simplest interpretation 
of these changes in variability is that "ceiling effects" on the aspira- 
tion scale curtailed variability on the posttest measure. 
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was found that womenj over the two-year interval? tended ta 
become '^pore homogeneous with respect to their intellectual orientations » 
The standard deviation of their scores decreased from 1„34 to 1„23 (t = 
2„36? p <i(s“05). It will be recalled that the value scoites discussed in' 

\ the preceding chapter were derived from importance ratings of clusters 
\of Job regiuiremebts considered in evaluating a satisfying. Job or careero 
‘fhe Job requirement most characteristic of the intellectual cluster 
( 1 . 0 eo.^ showing the highest average correlation with other members of the 
cluster) was "%ive me an opportunity to live and work in the world of 
ideas o" The results suggest that women were somewhat more homogeneous 
with respect to ratings of the importance of such requirements after 
completing the senior? than after completing the sophomore? year,, 

Changes in homogeneity on college press measures . The college 
press factors discussed in Chapter II are useful in summarizing the 
changes exhibited in the homogeneity of scores on the faculty and student 
■ press scales. It will be recalled that 9 of the press scales had their 
highest loadings on three oblique factors interpreted as faculty rapport 
factors. These 9 scales have been grouped together at the top of Table 
22? which summarizes changes in the variabilities of scores obtained in 
1965 and in 1967, It can be seen that generally scores on faculty 
rapport scales did not change with respect to variability. The two 
exceptions to this generalization were that? over the two-year interval.? 
men tended to become more heterogeneous with respect to scores on the 
scale? Student Opposition to Faculty Influence? and with respect to 
scores on the scale? Faculty Press for Independent Thinking, 

The changes in variability on the scale defining the second factor? 
faculty exactitude? were consistent for both sexes. The results indicate 
that student descriptions of the extent to which faculty members demanded 
strict compliance with regulations were more heterogeneous for teachers 
known in the senior year than for those known in the sophomore year, 

VirtuaU.y all of the significant differences shown in Table 22 for 
scales associated with factors C? D? E? and G can be accounted for by 
the effects of entering specialized fields of study. Thus the F-ratios 
for true-score covariance analyses in Tables 17 and 18 indicate that 
the effects of entering different fields of study were? for the most 
part? like those illustrated in Part I of Figure 2? and no further 
assumptions are required to account for the observed overall changes in 
variability on these scales. 

For both men and women? descriptions of the playfulness of close 
student colleagues were more heterogeneous after the senior? than after 
the sophomore? year. Finally? among men descriptions indicating the 
extent to which close peers exerted press for affluence or for academic 
achievement were more heterogeneous at the end of college than they were 
at mid-college. There is no readily apparent explanation for the latter 
changes. We have already seen in Chapter III that there were no effects 
on these scales associated with entering specialized fields of study? 
and we shall see in the next section that there were no consistent 
changes in mean score levels on these scales. 
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Changes in Average Levels on Student and College Measures 

Aspirations and related attitudes . Among men, there was only a 
trivial change in the average aspiration level from the first to the 
second survey (4,01 and 4,02, respectively); however, the difference 
between the initial level and the terminal level (4,20) was highly 
significant (t = 5,28, p<,0l). Among women, there was a tendency for 
aspirations to increase almost as much during the junior, as during t e 
senior, year of college. The mean scores for women for the initial, 
middle, and terminal surveys were 3,17, 3,37, and 3.65, respectively; 
the one-year gain was highly significant (t = 5,71, p<,01) as was the 
two-year gain (t = 12.10, p<,0l). 

The percentages of panel members making specific aspiration responses 
on each survey are shown in Table 23, and reveal essentially the same 
pattern shown by average levels of scale scores. Approximately 82 per 
cent of the men planned at least some graduate study after college grad- 
uation both on the first and second surveys, but by the completi^ of 
the senior year 92 per cent reported such plans. In contrast, the per- 
centages of women with such plans were 63, 74, and 88 on the initial, 
middle, and terminal surveys, respectively. 

As the panel progressed through college an increasing percentage of 
respondents reported that their close friends were planning to go on to 
graduate or professional studies. Table 23 shows that the combined per- 
centage of men indicating either that "all or almost all" or "more than 
half" of their close friends were planning such studies increased from 
46 to 63 per cent during the last two years of college. The corresponding 
percentages for women were 25 and 44, 

An extraordinarily high percentage of both men and women expressed 
confidence that they had the ability to successfully pursue an advanced 
graduate or professional degree: the percentage of men expressing such 

confidence increased from 95 to 99 during the interval between initial 
and final surveys; during the same period the percentage of women ex- 
pressing such confidence increased from 92 to 96 (Table 23), Judging by 
the college grade-point averages reported on each survey, the level of 
confidence displayed by the men (if not by the women) was probably un- 
realistically high. The percentage of men reporting an overall grade- 
point average for the first two years of college which had a letter grade 
equivalent of B- or higher was only 49; the corresponding percentage for 
women was 61, To be sure, there was a tendency for grades to improve 
during the upperclass years: 68 per cent of the men and 80 per cent of 

the women reported averages at least this high for the junior year; 76 
per cent of the men and 88 per cent of the women reported averages at 
least this high for the senior year. Yet it is clear that about a 
quarter of the men reported C averages during their senior year and at 
the same time expressed some confidence in being able to successfully 
pursue an advanced degree. 
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TABLE 23 



ChangGS in Aspirations and RGlatGd AttitudGS During thG CollGgG YGars 



PGrcGntagG making givGn rGsponsG 
on Gach survG.y 



Man 
TN =655) 



Women 
TN =523) 



Question and response 



1965 1966 1967 1965 1966 1967 



What are your educational plans 
for the future? (indicate the 
highest level of education you 
expect to complete o ) 

Three years of college 
Bachelor’s degree 
Some graduate study 
Master’s degree 
First-professional degree 
Academic doctorate 

Of your close friends in colleges 
how many are planning to go for 
graduate or professional studies? 
(choose one) 

All or almost all 
More than half 
Less than half 
Few or none 
Don ’ t know 

In your opinion, do you have the 
ability to successfully pursue 
a graduate or professional 
degree? 

No 

Probably No 
Probably Yes 
Yes 









1 


— 


— 


17 


18 


8 


37 


27 


12 


5 


5 


7 


16 


18 


23 


35 


34 


41 


39 


47 
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25 


25 


23 ■ 
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2 


1 


17 


18 


21 


6 


7 


10 



18 


29 


35 


7 


16 


16 


28 


35 


28 


18 


27 


28 


28 


21 


23 


31 


30 


29 


15 


12 


11 


32 


23 


23 


11 


3 


2 


12 


5 


4 



1 

4 

34 

61 



4 

33 

63 



1 

25 

74 



2 

6 

46 

46 



1 

5 

41 

52 



1 

2 

34 

62 
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ChangGS in studGnt valuGSo ThG valuG changes of greatest magnitude 
were the increases in individualistic orientations shown by both men and 
women (Table 24) « The job requirement most characteristic of the indi- 
vidualistic cluster was "leave me relatively free of supervision by others, 
and these changes may be interpreted as indicating that college students tend 
to become increasingly impatient with roles in which they are exposed to 
surveillance o 



Table 24 

Changes in Average Value Scores of Men and Women 







Men (N 


= 655 ) 






Women (N = 523.) 




Value score^ 


Mean scale 
score 

1965 1967 


Diff. 


t 


Mean scale 
score 

1965 1967 Diff. 


t 


Individualistic 

orientation 


6.2 


5.7 


. .5 


7.70** 


6.5 


6.2 .3 


5,27** 


Prosocial 

orientation 


5.9 


6.1 


-.2 . 


-3.17** 


6.5 


6.7 -.2 


-3.71** 


Affluence 

orientation 


5.2 


5.0 


.2 


2 . 84** 


4.6 


4.5 .1 


1.92 


Intellectual 

orientation 


6.0 


6.0 


— 


1.30 


5.8 


5.9 -.1 


-1.87 



^On the value scales low scores indicated stronger value orientations. 
Since 1967 scores were subtracted from 1965 scores, positive differences 
in this table represent increments, and negative differences decrements, 
in the given value. 

**p < . 01 

Coupled with the rise in individualism was a decline in altruism. 

Both men and women exhibited statistically significant decreases in pro- 
social orientations. The jou requirement most characteristic of 
latter cluster was "give me an opportunity to be helpful to others. 

Hence the results may be interpreted as indicating that college (or some 
other time-related factor) caused students to place less importance upon 
the opportunity to be helpful to others in considering a satisfying job 
or career. 

Finally, there was a significant increment in the affluence orienta- 
tions of men. The job requirement best epitomizing the affluence cluster 
was "provide me with a chance to earn a good deal of money." It may be 
seen that women exhibited a similar increase in the importance they placed 
on money, but this change was only of borderline significance (p<»06). 




56 



College press. Table 25 summarizes changes in average college 
press scores. It can be seen that on 7 of the 9 faculty rapport scales 
both men and women exhibited highly significant two-year gains in average 
scores. It seems clear that during the interval between completing the 
sophomore and senior years panel members showed a striking increase in 
faculty rapport. Table 25 shows that the largest increment in press 
reported by men was on the scale. j Faculty Press for Affiliation, We saw 
in Chapter II (Table 7) that the most characteristic item in this scale 
(i.e ,5 the item having the largest factor pattern coefficient) was "They 
took a personal interest in me and my work," The percentage of men 
either strongly or mostly agreeing with this item increased from 38 to 
53 during the interval from the initial to the final survey. Among 
women the largest increment in press was manifested on the scale? Faculty 
Press for Advanced Training, The percentage of women agreeing with the 
most characteristic item on this scale, "They encouraged students to do 
graduate study," increased from 48 to 65, But the differences between 
the sexes were relatively minorj perhaps the most impressive aspect of 
Table 25 is the fact that the overall ecological changes with respect 
to faculty rapport were virtually identical for men and women. For both 
sexes the largest increments in faculty press were on the scales for 
assessing the extent to which the faculty expressed affiliation, support- 
iveness, favorable evaluations of the student^ s ability, and strong 
press for advanced training or independent thinking. 

Although there were very marked changes in the rapport students 
enjoyed with the teachers they knew best, there were no corresponding 
increases in the average ratings of teaching excellence given these 
teachers. These findings do not support the hypothesis of a "halo 
effect" in student descriptions; on the contrary, they suggest that panel 
members were discriminating in descriptions of their teachers. 

Virtually all of the changes on the faculty rapport scales are 
congruent with the hypothesis that men and women become increasingly 
disposed to look upon their teachers as appropriate role models as they 
progress through college. Figures 3 and 4 show that changes in average 
scores on these scales tended to be a function of the length of exposure 
to upperclass instruction. Also Figure 3 shows that men tended to ex- 
hibit positively accelerated growth curves with respect to faculty 
rapport, while Figure 4 shows that women tended to exhibit negatively 
accelerated growth curves in this same factor of college press. This 
difference between the sexes in the rate with which faculty rapport seems 
to change during the upperclass years may be related to the finding dis- 
cussed earlier that women, but not men, tended to change their degree 
aspirations during the year of college. One interpretation of 

these results is that women tend, at an earlier developmental stage than 
men, to regard their teachers as appropriate role models, and as a con- 
sequence their dispositions to seek advanced training tend to change at 
an earlier point in the college years. 

Other changes in average scores on the faculty press scales shown 
in Table 25 can be summarized as follows: for both men and women there 
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DIFFERENCES BETWEEN AVERAGE PRETEST AND AVERAGE POSTTEST SCORES 
ON GIVEN FACULTY RAPPORT SCALE 
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Fig» 4„ Increases Exhibited by Women in Faculty Rapport 
Scale Scores During Upperclass Years in College 




61 



was a marked decrement in faculty exactitude (press for compliance) and 
a somewhat smaller decrement in faculty press for vocationalismo With 
respect to the parallel student scale. Student Press for Vocationalism, 
men exhibited a decline, but women a gain, in average scores. 

Two of the remaining changes in student press have already been 
intimated by changes in responses to single questionnaire items. Table 
23 shows that there was both an increase in the percentage of close 
friends planning to do graduate study and a moderate increase in the 
percentage expressing confidence in their ability to successfully pursue 
graduate study. Similarly, Table 25 indicates that for both men and 
women there were increases in student press for advanced training and 
decreases in student press for unfavorable self-evaluations. 



After the completion of the sophomore year:, men exhibited markedly 
lower scores than women on the student humanism scales (estheticism, 
reflectiveness, and intellectualisrn) , but during the upperclass years 
men tended to reduce the gap. During the last two years of college men 
showed significant increases, while women showed relatively little changes 
in scores on the student humanism scales. At the same time, there was an 
increase in student press for playfulness among men. 

Finally, there was a decrease in student press for affluence among 
women. Apparently, changes on the affluence items were small but con- 
sistent, and they suggest that the close student colleagues of our female 
panel members were perceived to be slightly less affluent at the end of 
college than two years earlier. For example, there was only a small 
decrease (16 vs, 13 per cent) in the percentage of women agreeing with 
the most characteristic item on this scale, ^^They were accustomed to 
having plenty of money.” Perhaps this change is related to the facts 
that women during the course of the study increasingly elected to describe 
students met in the their major field of study and less frequently de- 
scribed students met in their dormitories (cf. Table 12), and education 
was the major field of study for 1 out of every 10 of the female panel 
members. The final link in this account would of course be the assumption 
that education tends to recruit its majors from students of relatively 
modest means. 

Conclusions 



The degree of rapport panel members enjoyed with faculty members 
increased with length of exposure to upperclass instruction. Student 
descriptions of their college environments indicate that there were, 
from the initial to the final survey, large increments in faculty affil- 
iation, supportiveness, regard for the respondent’s ability, and press 
for advanced training and independent thinking. Women as well as men 
exhibited increases in degree aspirations over the two-year interval, 
and by the completion of college 9 out of every 10 of the panel members 
planned to do at least some graduate study. Accompanying these changes 
in personal plans were increases in the percentages of students report- 
ing that their close friends planned to pursue graduate work. In addition. 
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both men and women exhibited increases in individualistic, and decreases 
in prosocial, orientations « Many of these results are consistent with 
the hypothesis that during the later college years students are exposed 
to modeling stimuli from teachers and peers which increasingly argue for 
the appropriateness of advanced graduate or professional training, and 
as a consequence exhibit changes in related plans and attitudes. 

Descriptions of the teachers and peers known best by panel members 
became more heterogeneous as students progressed through college: from 

the initial to the final survey there were increases in the variabilities 
of scores on scales for assessing faculty press for compliance, humanities, 
science, and vocationalism and for assessing student press for vocational- 
ism, science, and playfulness. Many of these increases in heterogeneity 
of the college press reported appear to be the consequences of increased 
specialization in the major field of study. 

It was concluded that the criterion of an increment in pooled 
variance was not a valid symptom of differential treatment effects. 
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CHAPTER V 



COLLEGE EXPERIENCES AND CHANGES IN DISPOSITIONS 
TO SEEK ADVANCED TRAINING 

We saw in Chapter III that there was no evidence that entering 
specialized fields of study had differential effects upon plans to seek 
advanced graduate or professional degrees,, Yet the results in the pre- 
ceding chapter indicate that there were consistent increments in degree 
aspirations for both men and women, and that there were more or less 
concomitant changes in faculty and student press and in student values o 
These two sets of results are, of course, entirely compatible, and they 
suggest the possibility that there are ecological changes in the later 
college years, more or less common to all fields of study, that may 
affect student dispositions to seek advanced trainingo In this chapter 
we shall discuss tests of the general hypothesis that college press and 
other experiences during the last two years of college in part caused 
changes in student dispositions to seek advanced training. 

Effects of College Press upon Changes in Dispositions 

We shall consider first a methodological analysis designed to 
clarify the interpretation of results, and then discuss tests of the 
hypothesis that faculty and student press affect motivation for ad- 
vanced training. 

Estimating effects by partial correlations . The general strategy ^ ^ 

was to correlate changes in degree aspirations with college press reported 
at the end of the junior and senior years, holding initial aspirations 
constant. Lord ( 29) describes a hypothetical example which was persuasive 
in leading us to prefer a partial correlation approach as the means of 
studying the relationships of interest: 

(Suppose) we are anxious to increase the weight of ... students and 
we wish to know whether adding vitamins to their diet will achieve 
this result. We discover that the amount of vitamins eaten is ^ 
uncorrelated with gain in weight for the total group but that it 
is positively correlated with gain in weight for every subgroup of 
the total group. What do we conclude as to the value of the use 
of vitamins?. 0 o .The conclusion suggested by the data would be that 
the addition of vitamins to the diet does tend to produce a gain 
in weight, even though amount of vitamins given is uncorrelated 
with gain in weight in the total group.... The conclusion is that 
when one wishes to study the effect of some outside variable on 
gain in weight, or on gain in test score, the ordinary correlation 
between the outside variable and gain is not the coefficient of 
primary interest. For reasons that arise from the logic of the 
problem rather than from any purely statistical considerations, the 
decisive coefficient is the partial correlation between the third 
variable and final status, with initial status held constant. 

Partial correlation techniques seem to have been neglected in many 
cases where they are required (29, pp. 444-445). 
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Lord initially pointed out, and has recently re-emphasized, that the 
zero-order correlations entering into such partial correlations must 
be corrected for attenuation: 

We frequently can get along without correcting an ordinary 
correlation, o . for attenuation because we know in advance the 
general effect of the correction — it will make the correlation 
a little larger in absolute magnitude. Unfortunately? we 
cannot usually know in advance the effect of correcting a 
partial correlation for attenuation; the correction may easily 
change even the sign of the partial. In view of this, we can 
hardly afford to neglect the correction for attenuation (31, 
p, 36), 

Guilford (20, pp, 400-401) and Lord (31, p, 35) have summarized 
the appropriate formulas for correcting the partial correlation for 
attenuation due to errors of measurement in both initial and final 
status,^ Following this approach, we are interested in the partial 
correlation between each college press score and estimated true scores 
on the final criterion measure of disposition to seek advanced train- 
ing, holding constant estimated true scores on the initial measure of 
this disposition. 

Criterion measures of final d ispositions to seek advanced training . 
Two criterion measures were available from responses to the final survey: 
the first, called the aspiration criterion, was the highest degree level 
to which the respondent aspired, as scored by the procedures described 
in Chapter III; the second, which will be called the entry criterion, 
consisted of the dichotomous attribute of entering (scored 1) or not 
entering (scored 0) a graduate or professional school in Fall, 1967 
(cf. question 1, Survey No, 3, Appendix B). Although the question 
concerning plans for the coming Fall was the primary one used in diag- 
nosing entry, responses to additional items were inspected for consis- 
tency: for example, a few students said they had entered, but had not 

applied for admission to any, graduate or professional school (question 
3), and also answered the questions regarding reasons why they were not 
pursuing graduate study (questions 21-23); these students were scored 
as not immediately entering a graduate or professional school. Undoubt- 
edly, some of the respondents were delaying their entry into graduate 
study, for 43 per cent of the women and 25 per cent of the men indicated 
that they were planning to pursue graduate study, but not immediately 
(question 21). Thus while about 9 out of every 10 of these students 
said they were planning to do at least some graduate work, only 27.9 per 
cent of the women, and 56,5 per cent of the men, were diagnosed as enter- 
ing graduate or professional school immediately. The produce -moment 
correlations between the aspiration and entry scores were ,58 and .42 
for men and women, respectively. 



Ifhe description of the formula for correcting for attenuation in 
both X and Y scores given by Bereiter (9 , pp, 8-9) is erroneous since 
it omits l/r^x "the denominator. 
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MGSsiirGS of initisX disp osifion fo sggIc ad^^GncGd 'braining . I't is 
apparGnt that thG~studGnt ' s initial disposition to sGGk advancGd -training 
is inadsquatGly mirrorsd in his rGsponsG to ths singlG quGstionnairG itsm 
asking for statGd dGgrGG aspirations in 1965, and that a widsr array of 
rGsponsGS to rslatsd quGstions may yisld a mors rsliablG GstimatG of ths 
strGngth of ths initial disposition. Accordingly, wGightsd, linear com- 
binations of scores on selected predictor variables were derived by 
multiple-regression equations for predicting each of the criterion meas- 
ures. From initial survey re-turns 34 predictor variables were derived: 

11 of these were based upon responses to biographical questions concerning 
(a) initial degree aspiration level, (b) number of close friends planning 
graduate or professional s-tudy, (c) reported grade-point average during 
the first "two years’ of college, (d) reported grade-point average of 
closest friend at college, (e) confidence in ability to successfully pursue 
graduate s-tudy, (f) number of scholarships applied for at time of high 
school graduation, (g) reported rank in high school graduating class, 

(h) participation in honors programs in college, (i) occupational level of 
father or guardian, (3) mother’s educational level? and (k) father's edu- 
cational level; and the remaining 23 consisted of college press variables 
based upon 1965 responses to the scales already described. Table 26 
summarizes the correlations and the proportions of criterion variance 
predictable on the basis of (a) the single best predictor (which was 
invariably initial degree aspiration level, (b) the weighted combinations 
of the 7, 8, or 9 predictors accounting for the largest proportions of 
criterion variance, and (c) the weighted combination based upon the entire 
set of 34 predictors. The specific predictors included in the linear 
combinations of 7, 8, or 9 predictors are listed in Appendix E. 

TABLE 26 



Correlations between Predicted and Obtained Criterion Measures 



Number of 1965 Predictors 
used in deriving predicted 
criterion score 


Correlation: 
1967 Multiple -or 

Criterion Zero-order 


Proportion of 
Criterion Variance 
Associated with 
Predicted Score 


I. 


Women (N = 523) 






1 


Aspiration 


.538 


.29 


7 


Aspiration 


.568 


.32 


34 


Aspiration 


.590 


. 35 


1 


Entry 


.345 


.12 


8 


Eii'try 


.433 


.19 


34 


Entry 


.477 


.23 


II. 


Men (N = 655) 






1 


Aspiration 


.576 


.33 


9 


Aspiration 


.613 


.38 


34 


Aspiration 


.631 


.40 


1 


Entry 


.474 


.22 


9 


Entry 


.568 


.32 


34 


Entry 


.585 


.34 



The reliability of each of the weighted? linear composite scores, was 
estimated by a formula given by Nunnally (35, p, 231), using the test- 
retest correlations of the degree aspiration variable over a one-year 
interval as a minimal estimate of the reliability of the most heavily 
weighted component in each composite score « These correlations were .65 
and .68 for men and women, respectively. Similarly, these values were 
used as reliability estimates of other component predictors from the 
group of 11 biographical questions. Reliability estimates of the 1965 
press scores were identical to those given in Appendix C (Table C-2). 
Since initial aspiration level had by far the largest weight in each 
linear combination, it is apparent that using the one-year test- retest 
correlation as the reliability estimate for this component, yielded an 
underestimate (or lower boundary value) for the estimated reliability 
of each composite score. Accordingly, estimates of the reliabilities 
of the composite scores were also derived assuming a reliability of ,80 
for each of the biographical components. The reliability estimates of 
the composite scores, using both bases for estimating reliabilities of 
biographical components, are shown in Table 27. It can be seen that 
each composite score based upon multiple predictors was more reliable 
than the single score representing initial aspiration level. It appears 
that the composite scores provided superior estimates of initial dis- 
positions to seek advanced training, but that it made little difference 
whether one used the composite scores based on 7, 8, or 9 predictors or 
those based on 34 predictors. 



TABLE 27 

Estimates of Reliabilities of Weighted Composite 
Scores for Predicted ' Criteria 



Estimated reliability of composite 
Using bne-year Using .80 as 
test-retest reliability 
reliability as estimate of 
reliability of ; each 
each biographir biographical 



1967 cal component component 



Number of 1965 Predictors 


Criterion 


' Men 


Women 


Men 


Women 


1 (initial aspiration level) 


Aspiration 


.68 


.65 


.80 


.80 


7 or 9 


Aspiration 


.83 


.76 


.90 


.86 


34 


Aspiration 


.83 


.79 


.85 


.88 


1 (initial aspiration level) 


Entry 


.68 


.65 


.80 


.80 


8 or 9 


Entry 


.89 


.87 


.93 


.93 


34 


Entry 


.88 


.82 


.92 


.88 
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Effects of d ifferent corrections for attenuation upon partial 
correlations. Bereiter ( 9 ) has expressed pessimism about the prospects 
of applying Lord^s method of calculating partial correlations corrected 
for attenuation. He writes: 

One would like to be able to claim that this solves the over- 
correction-under-correction dilemma. Actually? the best that 
can be claimed is that it pushes it back one step. An over- 
estimate of r^x (the estimated reliability of the variable^ 
representing initial status) can make the correlation spuriously 
positive; an underestimate can make the correlation spuriously 
negative. ‘The only conclusion is that the error is likely to be 
smaller in magnitude than that found in other correlation 
coefficients (9 ? p. 9). 

However, it seems likely that this conclusion is valid only when the 
reliabilities of the component variables are relatively low, and, 
particularly, when considering partial correlations that are near zero 
in magnitude. In the present case, we are dealing with measures of 
initial status that have relatively high reliabilities, and the sign 
of the partial correlations may be relatively independent of whether 
or not corrections for attenuation are applied, and, if applied, they 
may be relatively unaffected by whether lower-boundary or stepped-up 
reliability estimates are used. To be sure, one would expect the 
sign of partial correlation coefficients having a near zero magnitude 
to fluctuate according to the particular reliability estimate used, 
but such fluctuation is relatively unlikely for uncorrected partial 
correlation coefficients that depart markedly from zero. In other 
words, the partial correlation approach may be considerably more robust 
than the statements of Lord and Bereiter indicate. 

To test this h 37 pothesis partial correlations were calculated for 
women between each 1967 press score and each criterion score, holding 
constant the appropriate predicted criterion score based upon 1965 
predictors. The data for women were used in these methodological 
comparisons since the weighted composite scores for women generally 
had slightly lower reliabilities (Table 27), and one would expect 
corrections for attenuation to have maximal effects upon these cor- 
relations. Table 28 summarizes the obtained partial correlations (a) 
when no corrections were made for attenuation, (b) when corrections 
for attenuation were made using the lower-boundary reliability esti- 
mates of measures of initial status discussed in the preceding section, 
and (c) when corrections for attenuation were made using the stepped-up 
reliability estimates of measures of initial status. For the latter 
two sets of correlations, corrections were also made for errors of 
measurement in assessing each criterion variable: for both the aspi- 

ration and the entry criterion scores the correlation between 1966 and 
1967 degree aspirations (.67) was used as the reliability estimate. 

This procedure probably resulted in an underestimate of the reliability 
of each criterion score; if so there was a slight bias introduced which 
tended to maximize differences in the magnitudes of the partial corre- 
lation coefficients which were, and were not, corrected for attenuation. 
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TABLE 28 — Continued 
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The results in Table 28 indicate that the discrepancies between the 
partial correlation coefficients based upon different corrections for 
attenuation? or upon none at all? were negligible. It can be seen that 
when the uncorrected coefficient was statistically significant? the 
coefficients corrected for attenuation confirmed without exception the 
sign of the uncorrected coefficient; moreover? the procedure of using 
corrections based upon lower-boundary or stepped-up reliability estimates 
had no effect upon the signs of these coefficients. It is obvious that 
the signs of the partial correlation coefficients did not exhibit the 
delicate dependence upon the particular reliability estimate of r^^ that 
Bereiter predicted. Since the coefficients uncorrected for attenuation 
appear to yield conservative estimates of the relationships? no correc- 
tions were appliedjj^artial correlations in the following analyses. Also? 
it is apparent from Table 28 that there were only negligible differences 
associated with the use of linear combinations based upon 7 or 8 pre- 
dictors or upon 34 predictors? and only correlations based upon all 34 
predictors are reported below. 

Test of effects of colle ge press . Table 29 summarizes the results 
of tests of the effects of faculty and student press upon changes in 
dispositions to seek advanced training. The senior-year scores of both 
men and women on four of the faculty rapport scales — Adequacy as Positive 
Role Models? Press for Independent Thinking? Enthusiasm for Intellectual 
Values? and Evaluations of Ability — tended to be related to changes in 
dispositions? as assessed by both criterion measures. In contrast? the 
junior-year scores of these students on the same scales were generally 
unrelated to changes in dispositions. The results obtained for women 
were clearly the more striking in this respect; on 8 of the 9 faculty 
rapport scales at the end of the senior year the scores of women were 
significantly related to changes in entry dispositions? but only the 
press assessed by one of these same 9 scales at the end of the junior 
year was significantly related to changes in entry dispositions. It is? 
of course? entirely reasonable that decisions to pursue graduate study 
are more highly related to the perceived qualities of teachers known in 
the senior year? since seniors are presumably more occupied with making 
plans for what they will do after graduation from college? and should 
be more susceptible to influences relevant to these plans. In any case? 
it is apparent from Table 29 that the senior year scores of women on the 
faculty rapport scales were more consistently related to changes in 
criterion scores than were the scores of men. This sex difference is 
congruent with differiances in responses to the question? asked on the 
last survey? "When did you make your plans to seek? or not to seek? 
graduate study?" It was found that 70 per cent of the women? as com- 
pared with only 54 per cent of the men? indicated they had made their 
plans during the third or fourth year in college. 

It will be recalled that in the previous chapter? changes in the 
faculty rapport enjoyed by women during the junior year were hypothesized 
as partial causes of changes in the aspirations of these students? parti- 
cularly the changes shown during the junior year. In contrast? the 
results in Table 29 indicate that the faculty rapport enjoyed by women 
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during thG junior yGar gGnGraXXy was not roXatod to changGS in aspirations 
of woman over the two-year intervaXo It is possibXej however, that the 
absence of any reXationship to X966 press scores was due to the increased 
aspirations of women recorded in X966 not being maintained by the very same 
women throughout the senior yearo NonetheXess, it is cXear that these ^ 
resuXts do not provide strong support for the interpretation advanced in 
Chapter IV of the junior-year changes in aspirations and the negatively 
accelerated growth curves in faculty rapport exhibited by women (Figure 4). 

Student press for advanced training was also mors or less consistent— 
Xy associated with changes in dispositions, with the associations for the 
senior year being sXightXy stronger than those for the junior yearo We 
shaXX see in the next section that a simiXar picture emerges when we con- 
sider partiaX correXations for responses to singXe questionnaire items 
concerning reXated coXXege experiences (cf= TabXe 30) » 

Effects of Other CoXXege Experiences upon Changes Dispositions 

In this section we shall consider partiaX correXations between 
dichotomous responses to singXe items and criterion scores, hoXding 
constant the appropriate predicted criterion scores as in the preceding 
section. The tabXes wiXX make cXear which attributes were weighted 
positiveXy (scored X) and which were weighted negativeXy (scored O). 

TaXking with others about graduate schooX , On both the X966 and^ 

X967 surveys, paneX members were asked whether they had discussed with 
others the possibiXity of entering a graduate or professionaX schooX. 

TabXe 30 shows that affirmative responses, particuXarXy on the Xast survey, 
were significantXy associated with increments in the disposition to go on 
for graduate study. Moreover, responses to the next question, ”With whom 
did you discuss the possibiXity of seeking advanced training?”, wore aXso 
highXy reXated to such increments. Thus, the reported acts of taXking 
with one’s academic advisor, with a facuXty member other than one’s ad- 
visor, with students at coXXege, and with parents were more or Xess con- 
sistentXy reXated to increased dispositions to seek advanced training. 

In contrast, the act of taXking a psychoXogicaX or vocationaX counseXor 
was reported by onXy about 8 per cent of the respondents and had weaker, and 
generaXXy insignificant, associations with such changes in dispositions, 

A reXated item of interest (not shown in TabXe 30) concerned the 
respondent’s subjective estimate of how his desire to seek advanced 
training was affected as a resuXt of such discussions with others. Of 
those paneX members who indicated that they had taXked with others 
about the possibiXity of graduate study, 60 per cent of both the men and 
the women reported that the discussions during the senior year had streng- 
thened their desire. The corresponding percentages for estimates of the 
effects of discussions during the junior year were 76 per cent and 60 per 
cent for men and women, respectiveXy, 
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On each of the later surveys, respondents were asked to think of 
the teacher who had the greatest influence on them during the past 
academic year, and to indicate whether this teacher had encouraged them 
to pursue a graduate or professional degree,, At the end of the junior 
year, 54 per cent of the men and 49 per cent of the women reported receiv- 
ing such encouragement, while at the end of the senior year 64 per cent 
of the men and 60 per cent of the women reported receiving such encour- 
agement from the most influential teacher that year. 

Academic achi evements in college . When panel members were asked 
to list the awards and honors they had received during the past year, 
the most popular responses were "No special honors" and Named on Dean’s 
Listo" The former response v^as given by 48 per cent of the panel at 
the end of the junior year, and by 45 per cent at the end of the senior 
year; the percentages giving the latter response were 34 and 42 for the 
junior and senior years, respectively <> It can be seen in Table 31 that 
the attribute of having won no special honors was generally negatively 
associated with increases in dispositions to seek advanced training, 
while being named to the Dean’s List was generally positively associated 
with increments in the disposition assessed by the aspiration criterion. 
The achievement of having won, during the senior year, a scholarship 
based upon one’s academic record was significantly correlated with in- 
creases in dispositions to seek advanced training among women, but not 
among men. 

The partial correlations for reported grade-point averages, shown 
in Table 31, indicate that grades during the senior year were somewhat 
more highly related to increments in dispositions than were grades during 
the junior year. The correlations for scores on the related press scale. 
Faculty Evaluations of Ability, were similarly greater for senior-year 
scores than for junior- year scores (Table 29). 

Participation in Honors Programs in college was neither very common 
nor very highly related to increments in desire to pursue graduate study. 
For the junior year 7 per cent, and for the senior year 8 per cent, of 
the panel members participated in such programs. With one exception, the 
partial correlations for participation in Honors Programs were insignifi- 
cant. 



Finally, we may note that undergraduate participation in research 
appeared to be related to change in desire to pursue graduate study. 
First, among men (but not among women) the report that one had been 
employed by a faculty member as a research assistant during the senior 
year was significantly related to increases in dispositions to seek 
advanced training. Second, the response that one had not had any 
experience in original research consistently had a negative correlation 
with such increases, although none of the individual partial correlation 
coefficients reached statistical significance. 
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Rival explanations of the resuil^o The results concerning the 
effects of talking with others about graduate school illustrate the 
difficulty of arguing in any very dogmatic fashion about the direction 
of the cause-and-effect relationships that may underlie the partial 
correlations we have just considered o Most of these correlations can 
equally well be accounted for on the basis of a reversed cause-and- 
effect relationship: the decisions that students made to pursue or not 

to pursue graduate study may have stimulated them to talk to teachers 
about their new plans? thereby producing the observed associations. 
However? this example also illustrates the probable erroneousness of 
any attempt to claim that all of the causation was exlusively in one 
direction. Even among students who had more or less committed them- 
selves to pursuing graduate study before talking with others? it is 
hard to imagine that the responses of others without exception had no 
effect. In truth? it seems likely that both causal directions were not 
only possible? but probable. In other words? it seems highly unlikely 
that either direction of causation can be ruled out: on the one hand? 

experiences in college undoubtedly affected dispositions to seek ad- 
vanced training; and? on the other hand? decisions to pursue graduate 
study undoubtedly affected the kinds of experiences panel members had 
in college. 

During the period of this study men who did not continue their 
education faced the prospect of being drafted for service in the Vietnam 
war? and it is possible that the draft made graduate study somewhat more 
attractive than it might otherwise have been. However? this external 
factor would be expected to reduce? rather than exaggerate? the asso- 
ciations we have considered. If a sizeable proportion of the male panel 
members were determined to pursue graduate study as a means of avoiding 
the draft? then their college experiences should have had relatively 
little effect upon whether they went on to graduate study. In short? a 
hypothetical tendency of college men to seek graduate study as a means 
of avoiding the draft was not a plausible rival explanation of the 
relationships found. 

Conclusions 



Numerous tests were made of hypotheses concerning the effects of 
college experiences upon dispositions to seek advanced training. The 
tests consisted of examining the statistical significance of partial 
correlation coefficients which held constant some 34 predictors indica- 
tive of initial dispositions to seek advanced training. The following 
hypotheses were confirmed: achieving good rapport with the faculty 

during the senior year of college increased desire to pursue graduate 
study; exposure to peers exerting press for advanced training increased 
such desire; talking with faculty members? students? and parents about 
plans for graduate study strengthened the desire to pursue graduate work; 
winning recognition for academic achievement in college strengthened 
dispositions for advanced training; and undergraduate research participa- 
tion by men made them more disposed to pursue graduate work. While these 
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tests in large part confirmed the research hypotheses, it was not possible 
to rule out an interpretation of the results in terms of a reversed cause- 
and-effect relationship « 

It was concluded that the signs and magnitudes of the partial corre- 
lation coefficients were not highly dependent upon whether the coefficients 
were corrected for attenuation; similarly, the coefficients did not vary 
appreciably according to whether one used lower-boundary or stepped-up 
reliability estimates in making corrections for attenuation. 
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CHAPTER VI 



CONCLUSIONS 

The major objective of this study was to evaluate the effects of 
different college environments upon student attitudes toward advanced 
training. In this concluding statement we shall review the most salient 
findings, and discuss the extent to which it is possible to rule out 
rival explanations of the results. Rival explanations may be grouped into 
two broad classes — those seeking to account for alleged effects in terms 
of statistical artifacts, and those seeking to account for such effects 
in terms of competing theoretical concepts. We shall first consider the 
extent to which it was possible to rule out artifacts as explanations for 
the results . 

Problems of Methodology 

Recent discussions of the problems in measuring change express 
considerable pessimism that solutions to persisting interpretative dilem- 
mas can be achieved. The results of this study suggest that the inter- 
pretative difficulties have been exaggerated, and that unde:' certain 
conditions conventional statistical techniques provide appropriate tests 
of causal hypotheses concerning changes in the attributes of college 
students. 

Estimates of the ecological effects of entering a major field of 
study appear to be the least equivocal of our results. It was possible 
to construe the longitudinal study as a quasi-experiment, and to control 
estimated true scores on the pretest by covariance analysis. Moreover, 
the use of marker variables for documenting certain highly predictable 
effects of entering scientific vs. humanistic curricula added to our 
confidence in the analysis. We have argued that it is not necessary to 
be able to claim that one has controlled every conceivable antecedent 
variable, or that one has ruled out every imaginable rival hypothesis. 

In the absence of random assignment of subjects to true experimental 
treatments such claims cannot be made. Rather, it is emphasized that 
the quasi-experimeiAt provides one plausible interpretation for the 
results—treatments caused effects — and this interpretation is persua- 
sive as long as no plausible rival interpretation can be discovered and 
documented. In the case of the ecological effects of entering a major 
field of study, the most obvious rival explanation in terms of biases 
introduced by errors of measurement in assessing initial status has 
been ruled out. 

It was also possible to draw a limited number of conclusions con- 
cerning the effects of entering selected fields of study upon student 
value orientations. Even though estimates of true scores on initial 
value orientations were not available, it can be argued with confidence 
that these effects were non-spurious. A formulation of the conditions 
under which differences between pairs of treatment means, adjusted by 
conventional covariance analysis, are non-spurious was developed and 
corroborated. 
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Turning next to the analysis of the effects of college experiences 
upon decisions to enter graduate or professional school? it is believed 
that rival explanations of the partial correlations in terms of measure- 
ment errors arising from the use of fallible variables can be ruled out. 

Overall? the results argue that quasi-experimental and observational 
data from longitudinal studies need not be hopelessly uninterpretable. 

On the contrary? we have demonstrated in a number of instances that con- 
ventional statistical techniques are more robust than has generally been 
supposed. In short? the results justify a considerably more optimistic 
outlook concerning the feasibility of untang]..ing causal effects in panel 
studies than has been customary. 

Theoretical Interpretations of the Results 

Entry into a major field of study . V!e have seen that during the 
later college years there was an increasing differentiation between majors 
in the physical sciences and in the humanities in the characteristics 
attributed to the teachers and students known best by the respondents. 
These results were the most dramatic? but they were also fairly typical 
of the trends on press scales not highly related to the scientific vs. 
humanistic dichotomy. For example? the correlations between the overall 
F-ratios from the true-score covariance analyses and the increments in 
treatment-outcome correlations averaged about .85 (Table 21)? indicating 
that significant field effects were accompanied by increasing different- 
iation between fields in perceived college environments. The most direct 
interpretation of this increasing differentiation in perceived college 
press is that it is the consequence of specializing in a major field of 
study. Are there rival interpretations of the phenomena? Donald T. 
Campbell (personal communication) has suggested a ’’fan-spread trajectory 
hypothesis?” which postulates that people in different colleges (fields) 
might exhibit a similar divergence over time even if college (field) 
impacts had not intervened. Such a finding would? of course? invalidate 
the explanation that real differences between teachers and peers in 
different fields of study caused the divergence in perceived press. 
However? while the fan-spread trajectory hypothesis may have some plau- 
sibility for differential field changes in student values? it is a highly 
implausible hypothesis regarding the ecological changes we have described. 

Newcomb and Feldman (33) suggest that processes similar to the 
increasing differentiation between fields observed in this study may be 
described in part as an accentuation or amplification of initial major- 
field differences. Thus these authors note that in other studies of 
changes by major field of study? average gains in student values for 
subgroups were moderately correlated with the average pretest scores of 
the subgroups. However? in the studies reviewed no attempt" was made to 
take account of the fallible nature of the variables measured. In the 
present study? correlations were computed between the mean initial scale 
scores of each major field and its mean adjusted posttest score based 
upon the true-score analysis of covariance. Among men? these correlations 
ranged from .47 to ,80 (with an average of .65) for the 5 scales showing 



significant field effects over the cne-year interval? while they ranged 
from -.62 to .88 (with an average of „50) for the 9 scales showing 
significant field effects over the two-year interval (Table 17). Among 
women? the two correlations for one-year effects were .75 and .78? while 
the correlations ranged from -ol3 to o79 (with an average of .62) for 
the 6 scales showing significant field effects over the two-year interval 
(Table 18). Moreover? the 3 scales showing negative correlations between 
mean initial scores and mean adjusted scores for fields were ones for 
which the F-ratios were generally of only borderline significance o Thus 
there is some validity to describing the differentiation process as an 
amplification of initial major-field differences. However? this char- 
acterization is in no way incompatible with the causal interpretation 
suggested in Chapter III, We can expect a modest degree of specialization 
in the major field even during the sophomore year of college? so that the 
initial ecological differences between students classified by their major 
fields should predict fairly well the ecological changes associated with 
further specialization in the major field, Newcomb and Feldman (33) 
similarly suggest that amplification of initial major-field differences 
may be interpreted in terms of differential reinforcement by academic- 
major experiences. 

Overall changes in students and in college environments , In brief? 
as panel members progressed through college they exhibited striking 
increments in the rapport they enjoyed with faculty members? in the 
extent to which they planned to seek advanced graduate and professional 
degrees? and in their individualistic value orientations. One may inter- 
pret these changes as reflecting an increasing identification with 
teachers? and this interpretation is generally consistent with the results 
obtained using alternative modes of analysis, 

A comparison of the fields effects with overall changes shown by 
panel members shows unmistakably that not all ecological changes can be 
adequately described as the accentuation of initial subgroup differences. 
Consider the fact that significant changes in average press score levels 
occurred on 7 of the 9 faculty rapport scales? while there were generally 
only small and insignificant field effects on these scales, A similar 
pattern was revealed on other press scales: overall decrements of great 

magnitude occurred with respect to faculty press for compliance and with 
respect to student press for unfavorable self-evaluations? though there was 
no evidence of field effects on these scales. The reverse kind of differ- 
ence was also manifest: there were field effects of great magnitude with 

respect to faculty press for science and for humanities? but virtually no 
evidence of overall changes in average scores on these scales. The con- 
clusion is inescapable that the analysis of changes in overall levels did 
in fact detect changes of a somewhat different order than those detected 
by the major field analyses. More importantly? we may conclude that the 
process of achieving identification with teachers was more or less common 
to all the fields of study considered. 
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Effects upon decisions to seek advanced training o We have seen 
that partial correlation tests generally confirmed the hypotheses that 
dispositions to enter graduate or professional school are strengthened 
by achieving good rapport with college teachers during the senior year? 
by exposure to peers exerting press for advanced training, by talking 
with others about plans to seek advanced training, by winning recognition 
for academic achievement, and, among men, by undergraduate research 
participation = A rival interpretation of these results is that t}^'pes 
of college press, talks with others, academic achievements, and under- 
graduate research participation were effects, rather than causes, of 
changes in dispositions to seek advanced trainings We have argued that 
the latter interpretation should be regarded as supplementary to — not 
competitive with — the causal interpretation we have proposed. For 
example, the college student who seeks out his advisor to discuss graduate 
study must have entertained the notion of such study before the conversa- 
tion, and one may say that the tentative commitment was the cause of the 
talk. But it is equally likely that what the advisor says to the student 
may encourage or discourage him, and in this case one may say that the 
talk affected the commitment to pursue graduate study. Both of these 
causal interpretations seem to be of such high plausibility that one may 
question whether they should be regarded as real competitors. In any 
case, we were not able to rule out the alternative interpretation. 

If it is true, as it appears to be, that men exhibited increases in 
identification with teachers fully as great as those shown by women 
(Table 25), then how can V 7 e account for the finding that the effects of 
achieving good rapport with teachers upon readiness to enter graduate 
school appeared to be much more consistent for women than for men (Table 
29)? Perhaps there was a "ceiling effect" for men, for 82 per cent of 
the men, as compared with only 63 per cent of the women, said on the 
initial survey that they planned at least some graduate study. After 
two years, an additional 10 per cent of the men, but an additional 25 
per cent of the women, reported such plans. Similarly, a much greater 
proportion of the women reported they made their plans to seek, or not 
to seek, graduate study during the third and fourth years of college. 

In other words, the process of identifying with teachers may have served 
primarily to maintain the initially high degree aspirations of men, while 
this process may have served mainly to elevate the aspirations of women. 

Recommendations 



The research suggests the following conclusions concerning methods 
of studying the impacts of college environments upon student attitudes. 
First, it is highly desirable to use quasi-experimental designs whenever 
possible. Second, a method of analysis which controls errors of measure- 
ment on the pretest is recommended. In most cases, the preferred method 
of analysis is the analysis of covariance using estimated true scores on 
the pretest as the covariate. Third, the inclusion of marker variables 
and prior formulation of the manner in which the varied treatments are 
expected to affect these variables is recommended. 
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Teachers and administrators interested in encouraging talented 
undergraduates to pursue advanced training should attempt to maximize 
the positive, and to minimize the negative, correlates of the adjusted 
criterion measures (Tables 29, 30, and 31) „ Clearly the process of 
achieving good rapport between faculty and students is one in which 
faculty members, as well as students, must participate. However, the 
results suggest that the rapport that counts is not primarily mediated 
by being friendly toward undergraduates, or even by presenting well- 
planned lectures. Rather it is more a matter of being a person students 
see as an appropriate model, of communicating one’s evaluations of the 
student’s ability, and of communicating enthusiasm for the intellectual 
life. 
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APPENDIX A 



TABLE A-1 

Colleges and Universities Attended by Respondents to 1965 Survey 



State 



College or University 



Number of 
panel members 
returning 
useable 

questionnaires 
to all surveys 



Alabama 


University of Alabama 


10 


Arizona 


University of Arizona 


14 


California 


California State College (Long Beach) 


11 




Chico State College 


22 




San Jose State College 


15 




Stanford University 


30 




University of California at Riverside 


30 




University of San Francisco 


32 




University of the Pacific 


22 


Colorado 


University of Denver 


25 


Connecticut 


University of Connecticut 


27 


Florida 


Rollins College 


30 


Georgia 


Emory University 


32 


Illinois 


Bradley University 


21 




Northern Illinois University 


24 


Indiana 


Indiana State University 


17 


Iowa 


University of Iowa 


25 


Kansas 


Kansas State Teachers College 


21 


Louisiana 


University of Southwestern Louisiana 


12 


Maryland 


Loyola College 


42 


Massachusetts 


Boston University 


17 




Clark University 


42 


Michigan 


Michigan State University 


21 




Northern Michigan University 


12 




Western Michigan University 


19 




University of Michigan 


21 



TABLE A-1 — Continued 



State 



College or University 



Number of 
panel members 
returning 
useable 

questionnaires 
to all surveys 



Minnesota 


Macalester College 


38 


Mississippi 


University of Mississippi 


13 


Montana 


University of Montana 


17 


Nebraska 


University of Nebraska 


18 


New Jersey 


Trenton State College 


41 


New York 


Colgate University 


36 




Hofstra University 


16 




Manhattan College 


32 




University of Rochester 


45 


North Carolina 


Davidson College 


36 


Ohio 


Bowling Green State University 


23 




Ohio University 


24 


Ore gon 


Lewis and Clark College 


33 




Oregon State University 


19 




Reed College 


24 


Pennsylvania 


Carnegie Institute of Technology 


32 




University of Pennsylvania 


17 


Tennessee 


University of Tennessee 


21 


Texas 


Lamar State College of Technology 


13 




North Texas State University 


5 


Utah 


Utah State University 


15 


Virginia 


University of Richmond 


29 .. 


Washington 


Washington State University 


19 


Wisconsin 


University of Wisconsin 


18 




Total 


1,178 



APPENDIX B 




In this appendix copies of each of the three survey questionnaires 
are reproduced. The date of each survey was follows: 

(1) August, 1965 — Survey of Career Plans of College Students 

(2) August, 1966 — Survey of Career Plans of College Students: 

Survey No. 2. 

(3) July, 1967 — Survey of Career Plans of College Students: 

Survey No. 3. 
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SURVEY OF CAREER PLANS OF COLLEGE STUDENTS 
Conducted by Vanderbilt University under a Grant from the U. S. Office of Education 

Identification Number 

(Last Name) (First Name) (Middle Initial) 

Present Home Address* 

(Street Address) (City) (State) 

*PLEASE MAKE SURE THE ADDRESS YOU GIVE IS ONE AT WHICH YOU CAN RECEIVE MAIL ONE YEAR 
FROM NOW. 

1. Sex. (Circle the number which corresponds to your sex.) 

Male 1 (7) 

Female 2 

2. Do you plan to be enrolled in college this Fall? (Circle one.) 

* Yes, I am continuing as a full-time student this Fall 0 (8) 

* Yes, I am continuing, but as a part-time student this Fall .... 1 

No, I have withdrawn but plan to return later 2 

No, I have withdrawn and do not expect to return .3 



* If "YES": PLEASE ANSWER a AND b. 

a. What class standing will you have this Fall? (Circle one.) 

Sophomore 0 (9) 

Junior ..... 1 

Senior 2 

b. Will you be enrolled in the same college you attended in Fall, 1964? 

(Circle one.) 

Yes 0 (10) 

* No 1 



* If "NO": What college or university will you be 
attending? 

(Name) ^ (City) (State) 



3. What are your educational plans for the future? 

Circle the number corresponding to the highest level of education you expect to 
complete. If you do not plan to seek any more higher education, circle the 
number most closely corresponding to the highest level of education you have 
already completed . 

I expect to complete three years of college 0 (11) 

I expect to get a bachelor’s degree 1 

I expect to do some graduate study but not enough for an 

advanced degree ^ 

I expect to get a Master’s degree 3 

I expect to obtain a first-professional degree (M.D. , D.D.S., 

L.L.B., or B.D.) ^ 



O 



I expect to obtain a Ph.D. or other equivalent academic doctorate 
degree 



4. Which of the following best describes where you lived during the past year? 
(Circle one.) <= r .y 

With my parents (or relatives) q 

Off-campus room, apartment house i 

* Dormitory or other campus housing 

* Fraternity or Sorority 3 



( 12 ) 



* IF "DORMITORY OR FRATERNITY/SORORITY": Was your residence arranged so that 

separate sections or lounges were available for the use of small groups of 
students? (Circle one.) & 



Yes (13) 

No 1 



5. How many roommates did you have during the past year? (Circle one.) 



None 

One 

Two 

Three or more 3 



(14) 



6. Were you a member of a social fraternity or sorority at your college? (Circle 



No 

Yes 



0 (15) 

1 



7. Have you participated in an Honors Program (special series of courses for 
undergraduates of outstanding promise or achievement) in your college? 
(Circle one.) 



No 0 (16) 

* Yes 1 



* IF "YES"; How many years have you participated in the Honors Program 
at your college? (Circle one.) 



One year 



0 



Two years 



1 



(17) 



8. Does your school have a student counseling center? (Circle one.) 
No 



0 



•* Yes 



1 



(18) 



* IF "YES'': What type of counseling opportunities were available at your 

counseling center? (Circle any which apply.) 






2 



VocatioMl counseling (Including opportunity to take vocational^ 
aptitude tests) 

Counseling on personal problems 

Counseling on study habits (rapid reading courses, etc.) • • • 2 

3 

Don’t know * ' * 



(19) 

( 20 ) 
( 21 ) 
( 22 ) 



9 Rate the frequency with which you have discussed your career plans with others 
duSng the pLt io years. (Circle one in each row.) 



Never discussed 
them with 
this group 



Once 



Twice 



Three or 
more times 



Discussions with academic 
advisor 

Discussions with faculty 
members other than my 
advisor 



Discussions with students 
Discussions with parents . 



0 

0 

0 



1 

1 

1 



2 

2 

2 



3 

3 

3 



(23) 

(24) 

(25) 

(26) 



Discussions with a professional 
psychological or vocational ^ 



(27) 



counselor 



10. What is the highest degree offered at your 
(Circle one.) 



school in your major field of stu^i 



Bachelor’s degree 

* Master’s degree 

* First-professional degree (M.D., D.D.S., L.L.B., B.D.) 

* Ph. D. or other equivalent academic doctorate degree. . . • 



0 

1 

2 

3 



(28) 



* TP YOHR SCHOOL ENROLLS CANDIDATES FOR GRADUATE OR WOFESSIONAL DEGREES 
K IZ SoR PIffiD OF STUDY, PLEASE ANSWER a AND b: 

, . U.V. tTonv flic^piissed advanced training with 

- “ranfidSs1:/S^/u:S ^n““3:salonal degneesY 
(Circle one.) 

0 

No 

, 1 

Yes, but seldom 

Yes, rather frequently 

b Are there any women pursuing graduate or professional degrees in 
JoS major'^field of studyT (Circle one.) 

Yes .... 

No . . . • 

Don’t know. 



(29) 



0 

1 

2 



(30 



11. Did you and your ^ &iend on campus simultaneously take any of the same 
courses last year? (Circle one.) 



f/y 



3 



Yes, one course 1 

Yes, two courses 2 

Yes, three or more courses 3 

12. How many of your close friends have made definite decisions about the career 
fields they plan to enter after college? (Circle one.) 

All or almost all ' 0 (32) 

More than half 

Less than half 2 

Few or none 3 

Don’t know 

13. Of your close friends in college, how many are planning to go on for graduate or 
professional studies? (Circle one.) 

All or almost all 0 (33) 

More than half 1 

Less than half 2 

Few or none 3 

Don’t know 4 

14. How many of your close friends in college have the same major field as you? 

(Circle one.) 

All or almost all . 0 (34) 

More than half 1 

Less than half. 2 

Few or none 3 

15 . During your college studies this past year have you had any experience in original 
research (participation in collecting and analyzing raw data or conducting an 
experiment, not writing papers based on published sources or doing experiments 
from a laboratory manual)? (Circle any which apply.) 

No, I have never participated in original research 0 (35) 

Yes, I have — 

participated in research as part of a course 1 (36) 

been employed by a faculty member as a research assistant. 2 (37) 

had an off-campus job (summer or during school year) 

working in research 3 (38) 

participated in a summer research training program 

sponsored by the government or private foundation. ... 4 (39) 

conducted a research project on ray own (e .g . ,independent 

study) 5 (40) 

other (circle and specify: ) ... 6 (41) 

4 ^ 



16. How many scholarships did you apply for at the time you were graduated from 
high school? (Circle the number of applications.) 

012345 678 or more (42) 



17. 



What was your approximate rank in your high school graduating class? 
the appropriate rank . ) 

In upper 5 per cent of class 

In upper 10 per cent of class 

In upper 25 per cent of class 

In upper half of class 

In lower half of class 

Don’t know (no information on rank given) 



(Circle 



0 (43) 

1 
2 

3 

4 

5 



18. What is your overall (cumulative) grade point average for undergraduate work 
at your college? 

IMPORTANT: If your school uses letter grades (A, B, C, etc.) please circle 

the code number which is closest to your letter grade average. 

WARNING: The number which you circle probably does not correspond to the 

number equivalent at your school (e.g., at most schools ’’straight A’ equals 
4.0; here it equals ”0”). 

If your school does not use a system of grades which can be converted to the 
usual letter grades, please circle the last category. 



(Circle one.) 



Letter Grade 

A . . 



Code Number 
. . 0 (44) 



A- 



1 



2 

3 



B- 



4 



5 

6 



C- or lower 



No equivalent. 



19. Using the same code numbers shown in the preceding question, estimate "the 
cumulative grade point average of your closest friend at college during the 
past year. (Circle one.) 

012345678 (45) 



20. In your opinion, do you have the ability to successfully pursue a graduate 
or professional degree? (Circle one.) 

,, ; .... 0 

Probably no ^ 

2 

Probably yes. 

Yes ^ 

5 




( 46 ) 



O 



21. How many — 

a. Older brothers or sisters do you have? (Circle one.) 

0 1 2 3 4 or more (47) 

b. Younger brothers or sisters do you have? (Circle one.) 

0 1 2 3 4 or more (48) 

22. Occupation of father or guardian. (Circle the one which best applies.) 

Profession requiring an advanced degree (lawyer, doctor, professor, 

minister, dentist, etc.) ^ 

Profession not requiring an advanced degree (ba nker, engineer, 

etc 

Owns or managGs business 

Supervisory or middle management executive (bookkeeper, cashier, ^ 

personnel officer, etc.) 

Sales and Clerical (insurance, real estate, retail clerk, ^ 

postal clerk, etc.) 

Owns or manages farm ^ 

Skilled tradesman (carpenter, electrician, machinist, etc.) .... 6 

Factory worker (laborer, farm laborer, janitor, mine laborer) ... 7 

23. Estimate the approximate income of your parental family. Consider annual 
income from all sources before taxes. (Circle one.) 

Less than $5,000 per year ° 

$5,000 to $7,499 per year ^ 

$7,500 to $9,999 per year ^ 

$10,000 to $14,999 per year ^ 

4 

$15,000 or more per year 

I have no idea ^ 

24. Religion: 

a. In which you were reared. (Circle one.) 

Protestant (Circle and specify: ) ° 

Roman Catholic 

Jewish ’ 

^ 3 

other (Circle and specify: 

4 

None 

b. Your present preference. (Circle one.) 

Protestant (Circle and specify: ) ° 

Roman Catholic 

6 




O 



2 

Jewish 

Other (Circle and speci:fy: ) ^ 

. . 4 

None 

25. Are you married or engaged to be married? (Circle one.) 

NO 0 

* Yes, engaged to be married ^ 

** Yes, married ^ 

* IF "ENGAGED”: When do you plan to be married? (Circle one.) 

Within a year ® 

Within two years ^ 

Other (Circle and speci:fy: ) ^ 

** IF "MARRIED”: What will your spouse most likely be doing next 
year? (Circle the one which best applies.) 

Working full time ° 

Housewife, mother ^ 

Going to school ^ 

3 

Military Service 

26. While attending college last year how frequently (on the average) did you date? 
(Circle one.) 

T ... 0 (56) 

Never, or very rarely 

About once a month ^ 

About once every two or three weeks 2 

Once a week 

4 

Twice a week 

Three times a week ^ 

Four or more times a week ^ 

27. How much formal education did your parents have? (Check the highest level 
attained by each parent.) 

(57) (58) 

Father Mother 

Some grade school ^ ® 

Finished grade school 1 ^ 

0 2 

Some high school ^ 

Finished high school ^ ^ 

Some College ^ ^ 

O 

ERIC 



7 



Finished college (Bachelor’s degree). .5 5 

Completed Master’s degree 6 6 

Completed Ph.D. or first-professional 

degree (M.D., L.L.B.,etc.) 7 7 

Don’t know 8 8 

28. Your racial background. (Circle one.) 

White 1 (59) 

Negro 2 

Oriental 3 

Other (Circle and specify: ) 4 



29. Have you ever served in the Armed Forces? (Circle one.) 

V 

No 0 (60) 

Yes .... . 1 



30. Which of the following do you consider important requirements for a satisfying 
.joh or career ? (Circle one in each row.) 

Highly 

important Important Unimportant 



a. Provide me an opportunity' to use 
my special abilities and 

aptitudes 1 2 3 (61) 



Provide me with a chance to earn 
a good deal of money 


1 


2 


3 


(62) 


Give, me an opportunity to live and 
work in the world of ideas. . . . 


1 


2 


3 


(63) 


Provide me an opportunity to work 
on the application of knowledge 
to practical affairs 


1 


2 


3 


(64) 


Provide me an opportunity to work 
on theoretical problems regard- 
less of practical value ..... 


1 


’2 


3 


(65) 


Permit me to be creative and original 


1 


2 


3 


(66) 


Give me social status and prestige 


1 


2 


3 


(67) 


Give me opportunities to work with 
people rather than with things. . 


1 


2 


3 


(68) 


Enable me to look forward to a 
stable , secure future 


1 


2 


3 


(69) 






8 



Leave me relatively free of super- 
vision by others 


1 


2 


3 


(70) 


Give me a chance to exercise 


1 


2 


3 


(71) 


ProvidG mG with advGntxirG • . . • 


1 


2 

j 


3 


(72) 



m. Give me an opportunity to be 2 

helpful to others 



I Major Field of Study and Anticipated Career 



LIST OF MAJOR FIELDS AND OCCUPATIONS 

The following list of code numbers is to be used in answering 
through 34 below. Please read the instructions for these 

usitig the list. 



01 Agricultural and Related Fields 

■qI Agricultural Sciences (.includ- 

ing Animal Husbandry, Agronomy, 
Farm Management, Horticulture, 
Soil Science, Soil Conservation, 
etc . ) 

03 Forestry, Fish and Wild Life 

Management 

04 Farming (Code as occupation 

only, not as field of study) 

09 Biological Sciences 
,10 Biology 

11 Biochemistry 

12 Botany and Related Plant Sciences 

(Plant Pathology, Plant Physi- 
ology, etc.) 

13 Biophysics 

14 Physiology 

15 Zoology 

16 Other Biological Science Fields 

Education (code as occupation only) 

17 Elementary School Teacher (includ- 

ing Kindergarten and Nursery 
School) 

18 Secondary School Teacher 

Engineering 

19 Aeronautical 

20 Civil (including Agricultural, 

Architectural, Civil, Sanitary) 

21 Chemical (including Ceramic) 

22 Electrical 

23 Mechanical 

24 Metallurgical 

25 Mining 

26 Engineering, General and other 

specialties 



Questions 31 
questions before 

05 Business and Administration 

06 Accounting 

07 Military Service, Military 

Science 

08 All other business and commer- 

cial fields (Business Admin- 
istration , Marketing , 
Insurance, Finance, Industri- 
al Relations, etc.) 

Phvsical Science (NOTE; Secondary 
School Science Teaching is clas- 
sified under Education) 

41 Astronomy, Astrophysics 

42 Chemistry (excluding Bio- 

chemistry which is 11) 

43 Physics (excluding Biophysics 

which is 13) 

44 Geography 

45 Geology, Geophysics 

46 Physical Science, General and 

other specialties 



47 Psychology 

48 Clinical Psychology (code as 

graduate field or occupation 
only) 

49 Other psychology specialties 

(code as graduate field or 
occupation only) 

Social Sciences 

50 Anthropology, Archeology 

51 Economics 

52 History 

53 Political Science, Government, 

International Relations 

54 Sociology 

55 Social Science, General and 

Other 
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Health Professions 

27 Dentistry 

28 Medicine 

29 Nursing 

30 Pharmacy 

31 Veterinary Medicine 

32 Medical Technology or Dental 

Hygiene 

33 Other Health Fields or occupations 
Humanities 

34 Fine and Applied Arts (Art, Music, 

Speech, Drama, etc.) 

35 English, Creative Writing 

36 Classical Languages and Literatures 

37 Modern Foreign Languages and 

Literatures 

38 Philosophy 

39 Law (Code as professional field or 

occupation only) 

40 Mathematics and Statistics (NOTE: 

Secondary School Mathematics Teaching 
is classified under Education) 



Other Fields and Occupations 

56 Architecture, City Planning 

57 Foreign Service, (Code as 

occupation only not field of 
study) 

58 Home Economics (Code either as 

a field of study or as an 
occupation if you mean work- 
ing as a home economist for 

pay) 

59 Housewife (Code as occupation 

only, not as field of study) 

60 Journalism, Radio- Tele vision. 

Communications 

61 Library Science, Archival 

Science 

62 Social Work, Group Work 

63 Theology, Religion (Employment 

as a Clergyman or religious 
worker) 

70 Field of Study or Job Which has no 
Near Equivalent in This List 
(If you use this code, please 
describe your field or career in 
a word or two under the questions 
where it applied . ) 



INSTRUCTIONS: The preceding two-digit codes can be used to describe a 

field of study or a type of job. Thus, for example, in answering Ques- 
tion 31 below about fields of study, select the code number correspond- 
ing to your undergraduate major field of study; in answering Question 34, 
which asks about your anticipated career field, select the code number 
corresponding to the occupation you expect to enter. 

When you have chosen the major field or occupation from the list which is 
your answer to one of the questions below, please write the two numbers of 
that field or occupation in the double box at the end of that question. 

For example, if "Psychology" is your major field of study, write its code 
number (47) in the boxes at the end of question 31 thus: 




IMPORTANT NOTE; Certain code numbers should be used only for coding occupa- 
tions, not for coding major field of study. Students who plan careers as 
Elementary Teachers or Secondary School Teachers should use "Education" codes 
only to describe their anticipated careers; they should code their major 
fields of study according to the academic field in which they are majoring. 
Students who plan careers as college or university teachers should code both 
their major field of study and their anticipated careers according to the 
appropriate academic field codes. 



31. What will be your major field of study during the next two years in college? 

If you will have a joint major, write in the boxes the code 
number of the one in which you will have the most course 
credits . 



(74- 

75) 



32. Major field of study of your closest friend in college? 



(76- 

77) 



33. Future graduate or professional major? 

If you do not plan to ever go to graduate or professional 
school, write "00" in the boxes. 



(78' 

79) 



If you plau study iu several fields, give the main one. 



34. Anticipated career field? 



Please give what you expect to be your long-run career and 
l^ore Iny school, stop-gap, or temporary military 
service which might precede it. 



(7- 

8 ) 



I Descriptions of Your Undergraduate Eir^ronment~) 

NOTE: The purpose of this section is to 

environment during the past sch^l • particular college 

&:2rpSS;aS rit^rtitl&s,^; f Its^Ltures, La sensed its expec- 
tations and demands. What kind of place was i . 

Remember, your "^h’^vw^LLJoS^^rLpLeL .^^vLLrLpLLf wlll'*^ be 

on this research project, will ev y +^,Hon-t-c3 nr vour college. They will be 

s%rti:sfLoLe;ri: your cLiege 

environment last year. 

_ . . „4-r. -In PAPT A are about faculty members with whom 

cL"? Tave^oL besfauring thLpast year-thelr 
you have had most of and emphases, and their formal and inform- 

courses and teaching met ^ . jj^g^e hLe may or may not correspond to 

al interactions with you . ^be ra g y oP college or 

b?sf dfSg1bfL“ “wf w:LVoLtf resfr&eir Uvior and the ejects 
of their behavior upon you. 

of their behavior upon you. The numbers m the rating scale s 
interpreted as follows: 

1 - strongly disagree; highly uncharacteristic and almost always 

false as a description of them. 

2 - Mostly disagree; mostly false as a description of them. 

3 - Neither agree nor disagree; true about as often as it was 

false as a description of them. 

4 Mostly agree; mostly true as a description of them. 

5 - Strongly agree ; highly characteristic and almost always true 

as a description of them. 

r.TRhT.K THE NUMBER WHICH CORRESPONDS TO YOUR RATING FOR EACH DESCRIPTION 

How the rating scale is to be used can be illustrated with the following 
statement: 

"The faculty participated with students in many out-of-class activities." 

If you should "mostly agree" that this statement characterized your teachers last 
year, you would mark as follows: 



The faculty participated with students in many 
out-of-class activities . 



Disagree 
12 3 



Agree 

® 5 
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PLEASE ANSWER EVERY ITEM IN PART A 



PART A — DESCRIPTIONS OF FACULTY MEMBERS ] 

Disagree Agree 

35 . They seemed to have little genuine enthusiasm for the 



intellectual life. 


1 


2 


3 


4 


5 


(9) 


36. They were sensitive to student complaints and 

grievances and frequently tried to remedy the 
situation . 


1 


2 


3 


4 


5 


(10) 


37. They offered many really practical courses designed 
to prepare the student for his occupation. 


1 


2 


3 


4 


5 


(11) 


38. They did little to help the student develop his 
imaginative and creative capacities. 


1 


2 


3 


4 


5 


(12) 


39. They usually demanded strict compliance with all 
course requirements. 


1 


2 


3 


4 


5 


(13) 


40. The grades they gave me suggested that I was not 
unusually qualified for graduate work in the 
field . 


1 


2 


3 


4 


5 


(14) 


41. They showed no interest in tracing the sources of 

their specialized field of study to philosophical 
or humanistic movements in the history of ideas. 


1 


2 


3 


4 


5 


(15) 


42. They encouraged students to do graduate work. 


1 


2 


3 


4 


5 


(16) 


43. They often stressed the limited usefulness of the 
concepts and methods of science . 


1 


2 


3 


4 


5 


(17) 


44. On the whole I am grateful to them for showing me a 
way of life worthy of imitation. 


1 


2 


3 


4 


5 


(18) 


45. Their lectures clearly revealed they had put a 
great deal of energy and thought into doing a 
good job of teaching. 


1 


2 


3 


4 


5 


(19) 


46. They were not unusually skillful in getting to 
know students as individuals. 


1 


2 


3 


4 


5 


(20) 


47. They clearly conveyed to me a sense of what it 

means to become deeply involved in a discipline 
or subject. 


1 


2 


3 


4 


5 


(21) 


48. Students having difficulty with their courses 
could not expect to get special tutoring or 
counsel from them. 


1 


2 


3 


4 


5 


(22) 


49. They rarely tried to give the student the 

practical training he will need in his career 
field . 


1 


2 


3 


4 


5 


(23) 


50. They felt free to go into absolutely anything in 
tiying to get students to develop their 
individual interests. 


1 


2 


3 


4 


5 


(24) 


51. They sometimes waived requirements for admission 
to their courses. 


1 


2 


3 


4 


5 


(25) 


52. Their evaluations of my academic performance 

convinced me that I had a flair for course work 
in this area. 


1 


2 


3 


4 


5 


(26) 
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I PART A — DESCRIPTIONS OF FACULTY MEt4BERs| 





Disagre 


G 


Agree 




53, They frequently encouraged students to take courses 
in the humanities. 


1 


2 


3 


4 


5 


(27) 


54, They spent little or no time counseling stodents 
about opportunities for graduate study in their 
field . 


1 


2 


3 


4 


5 


(28) 


55, They stressed the value of the objective methods 
of science in finding answers to empirical 
questions. 


1 


2 


3 


4 


5 


(29) 


56, By and large they were not the kind of person I’d 
like to be. 


1 


2 


3 


4 


5 


(30) 


57, Their lectures were occasionally somewhat rambling 
and unorganized. 


1 


2 


3 


4 


5 


(31) 


58. They really talked with the students, not just at 
them. 


1 


2 


3 


4 


5 


(32) 


59. They were mostly content to follow their art or 
field of knowledge desultorily or 
superficially • 


1 


2 


3 


4 


5 


(33) 


60. They expected the undergraduate to get by almost 
coniplG'tGly on his own rGsourcGS. 


1 


2 


3 


4 


5 


(34) 


61. Very few of their courses were aimed at preparing 
the student for his vocation. 


1 


2 


3 


4 


5 


(35) 


62. They typically adjusted assignments and projects 
to fit the student’s unique interests. 


1 


2 


3 


4 


5 


(36) 


63. They were very reluctant to approve any exceptions 
in the curriculum requirements for graduation . 


1 


2 


3 


4 


5 


(37) 


64. They provided personal evaluations of my ability 
which made me realize I had potentiality as a 
contributor in my field of study . 


1 


2 


3 


4 


5 


(38) 


65. They seemed to have very little interest in drama 
or the arts . 


1 


2 


3 


4 


5 


(39) 


66. They showed little interest in recruiting students 
into their field of study. 


1 


2 


3 


4 


5 


(40) 


67. They sometimes criticized the trivial problems on 
which many scientists choose to work. 


1 


2 


3 


4 


5 


(41) 


68. A few of them were the kind of person one can’t 
help using as a model for oneself. 


1 


2 


3 


4 


5 


(42) 


69. They were extremely efficient and skillful in 
their use of class time . 


1 


2 


3 


4 


5 


(43) 


70. •They took a personal interest in me and my work. 


1 


2 


3 


4 


5 


(44) 


71. They -typically exhibited great interest in, 

and enthusiasm about, their field of study. 


1 


2 


3 


4 


5 


(45) 


72. Their counseling and guidance were really personal, 
patient, and extensive. 


1 


2 


3 


4 


5 


(46) 
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PART A — DESCRIPTIONS OF FACULTY MEMBERS 



73. They frequently expressed the belief that the main 
purpose of college is to prepare the student for 
his vocation. 



Disagree Agree 

123 45 (47) 



74. They provided the student little or no opportunity 
to pursue independent study under their 
supervision . 


1 


2 


3 


4 


5 


( 48 ) 


75 . They often permitted students to deviate somewhat 
from published curriculum requirements in their 
course work. 


1 


2 


3 


4 


5 


( 49 ) 


76. They rarely gave the student enough feedback on 
his work to really know what his strong points 
were . 


1 


2 


3 


4 


5 


( 50 ) 


77. They tried to get students interested in the 
humanities . 


1 


2 


3 


4 


5 


( 51 ) 


78. They tried to persuade qualified students to 
seek advanced training in their field of 
study . 


1 


2 


3 


4 


5 


( 52 ) 


79. They encouraged student interest in understanding 
developments in modern science . 


1 


2 


3 


4 


5 


( 53 ) 


80. They did not make much of a difference in ny life 
beyond the specific information they imparted. 


1 


2 


3 


4 


5 


( 54 ) 


81. They often seemed bored with their teaching 
assignments . 


1 


2 


3 


4 


5 


( 55 ) 


82. I never got to know any of them well enough to 
count them as good friends. 


1 


2 


3 


4 


5 


( 56 ) 


83. They did not appear to have any strong and active 
research interests in their field of study . 


1 


2 


3 


4 


5 


( 57 ) 


84. They tried to restrict appointments for planning 
study programs to one or two periods during 
the year. 


1 


2 


3 


4 


5 


( 58 ) 


85. Their courses tended to make students more practical 
and realistic. 


1 


2 


3 


4 


5 


( 59 ) 


86. They urged their students to undertake independ- 
ent research projects. 


1 


2 


3 


4 


5 


( 60 ) 


87. They were relatively permissive when it comes to 
enforcing rules regarding course prerequisites. 


1 


2 


3 


4 


5 


( 61 ) 


88. They made little effort to give special recogni- 
tion to students who did exceptional work. 


1 


2 


3 


4 


5 


( 62 ) 


89. Student interest in understanding and criticizing 
important works in art, music, and drama was 
encouraged by the faculty. 


1 


2 


3 


4 


5 


( 63 ) 


90. They taught their courses as if most of their 
students were going into graduate study. 


1 


2 


3 


4 


5 


( 64 ) 


91. It was obvious that they believed the American 
college has overemphasized education in the 
sciences . 


1 


2 


3 


4 


5 


( 65 ) 
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PART A — DESCRIPTIONS OF FACULTY MEMBERS 

Disagree Agree 



92. Most of their opinions and values still seem 
somewhat alien and ivory- towered to me. 



123 45 ( 66 ) 



93, In their lectures the presentation of material 
was extremely well planned and illustrated • 


1 


2 


3 


4 


5 


(67) 


94. They were typically warm and friendly in their 
relations with me . 


1 


2 


3 


4 


5 


(68) 


95 .- It was obvious that they had fallen in love with 
the search for knowledge. 


1 


2 


3 


4 


5 


(69) 


96. They often discussed the students’ goals with them 
and tried to help them discover their special 
talents. 


1 


2 


3 


4 


5 


(70) 


97. Very few of their courses here will be useful to 
students who go into business or industry. 


1 


2 


3 


4 


5 


(71) 


98. They were too busy to hunt for ways of getting 
students to develop initiative . 


1 


2 


3 


4 


5 


(72) 


99. They were inflexible in enforcing deadlines for 
course requirements. 


1 


2 


3 


4 


5 


(73) 


100. They gave me extensive, evaluative comments on 

my term papers and examinations in their courses. 


1 


2 


3 


4 


5 


(74) 


101. They had little appreciation for scholarship in 
the humanities. 


1 


2 


3 


4 


5 


(75) 


102. They did not present much information about careers 
in their field of study. 


1 


2 


3 


4 


5 


(76) 


103. They frequently encouraged students to take 
elective courses in the sciences. 


1 


2 


3 


4 


5 


(77) 


104. I admired most of them as persons not just as 
professors . 


1 


2 


3 


4 


5 


(78) 


105. Some of them were typically not adequately prepared 
to lecture on the day’s topic. 


1 


2 


3 


4 


5 


(79) 


106. They seemed to feel that teachers should maintain 
a certain amount of ’’emotional distance” from 
students . 


1 


2 


3 


4 


5 


(80) 



PART B — DESCRIPT IONS OF STUDENT ASSOCIATES) 



INSTRUCTIONS FOR PART B; Statements in PART B are about the undergraduate colleagues 
you know best. Your answers to this part should tell us what was generally charac- 
teristic of the undergraduate students you knew best, identified with, or associated 
with most commonly during the past year. The ratings you make for your personal 
associates in your undergraduate school may or may not correspond to the way you would 
rate undergraduate students in general or other groups of students at your college . 

Describe only those students you knew best and associated with most commonly. They 
may, or may not, be students in your major field, living quarters or campus clubs. 



I 

■\ 







107. Where did you meet the undergraduate colleagues you will be describing? 
(Circle the one which best applies.) 

Dormitory or rooming house 

My Fraternity or Sorority (or equivalent) 

Campus activities 

Class in my major field of study 

Other (Circle and specify ) 



1 

2 

3 

4 

5 



( 7 ) 



108. Does this group include both men and women? (Circle one.) 



No, men only 1 (g) 

Yes, but primarily men 2 

Yes, but primarily women 3 

No, women only 4 



DIRECTIONS ; Follow the same rating directions shown for Part A. 

PLEASE ANSWER EVERY ITEM IN PART B 



Disagree 

109. They had strong interests in poetry, music, painting, 

sculpture , architecture , etc . 123 

110. Getting top grades was of little importance to most ^ 

of my associates. 123 



Agree 

4 5(9) 

4 5 (10) 



111. Few of them were eager to go out and start working 
in the practical world. 



123 45 ( 11 ) 



112. Books dealing with psychological problems or 

personal values were widely read and discussed 



by them. 


1 


2 


3 


4 


5 


(12) 


113. On the whole they had greater difficulty competing 
for grades than I. 


1 


2 


3 


4 


5 


(13) 


114. Most of my friends were planning to enter careers 
which required graduate or professional degrees. 


1 


2 


3 


4 


5 


(14) 


115 . They talked frequently about the philosophy and 
methods of science . 


1 


2 


3 


4 


5 


(15) 


116. Most of them felt their teachers had helped them 
to achieve greater direction, force, and 
clarity. 


1 


2 


3 


4 


5 


(16) 


117 . We shared with each other the excitement of 
intellectual discoveries. 


1 


2 


3 


4 


5 


(17) 


118. Many of them owned sports cars. 


1 


2 


3 


4 


5 


(18) 


119.- We rarely had much time for play or recreation. 


1 


2 


3 


4 


5 


(19) 


120. They would regard a stud'ent who insisted on 

analyzing and classifying art and music as a 
little odd. 


1 


2 


3 


4 


5 


(20) 
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Agree 



PART B — DESCRIPTIONS OF STUDENT ASSOCIATES 



Disagree 



121. My friends were successful in getting mostly A^s 

and B’s in their courses last year. 

122. They often complained that their college courses 

were not giving them the practical training 
they will need in their career fields. 



4 5 



( 21 ) 



4 5 (22) 



123. They had very little interest in the analysis of 
value systems, and the relativity of societies 
and ethics. 


1 


2 


3 


4 


5 


(23) 


124. My associates were more talented and better 
equipped to pursue their studies than I. 


1 


2 


3 


4 


5 


(24) 


125 . Few of them were seriously considering occupations 
which demand advanced graduate or professional 
training. 


1 


2 


3 


4 


5 


(25) 


126. They would have vexy little interest in attend- 
ing a lecture by a prominent scientist. 


1 


2 


3 


4 


5 


(26) 


127. They were generally dissatisfied and disappointed 
with their teachers. 


1 


2 


3 


4 


5 


(27) 


128. My friends had no strong intellectual 
commitments . 


1 


2 


3 


4 


5 


(28) 


129. Most of them came from wealthy families. 


1 


2 


3 


4 


5 


(29) 


130. Their parties were frequent and a lot of fun. 


1 


2 


3 


4 


5 


(30) 


131. A lecture by an outstanding poet or dramatist 
would attract vexy few of them. 


1 


2 


3 


4 


5 


(31) 


132. They were critical of students who were content 
just to get by with grades of C. 


1 


2 


3 


4 


5 


(32) 


133. They often talked about the jobs that will be 
available to them after graduation from 
college. 


1 


2 


3 


4 


5 


(33) 


134. They would have little interest in a lecture by 
a visiting philosopher or theologian. 


1 


2 


3 


4 


5 


(34) 


135. Most of my associates had higher grade point 
averages than I. 


1 


2 


3 


4 


5 


(35) 


136. None of them had much interest in doing research 
in their field of study. 


1 


2 


3 


4 


5 


(36) 


137. They rarely took any more science courses than were 
required . 


1 


2 


3 


4 


5 


(37) 


138. Most of my associates were grateful to the faculty 
for showing them a way of life worthy of 
imitation . 


1 


2 


3 


4 


5 


(38) 


139. They tended to avoid stedents who liked to 
exercise their intellectual abilities. 


1 


rv 


3 


4 


5 


(39) 


140. Many of them had to work part-time to pay their 
college expenses. 


1 


2 


3 


4 


5 


(40) 



uc 






PART B — DESCRIPTIONS OF STUDENT ASSOCIATES 



141. Our gathering places ware typically activa and 
noisy. 



Disagraa 
12 3 



Agraa 
4 5 



( 41 ) 



142. Whan thay got togathar thay oftan talk about 

trands in art, music or tha thaatar. 

143. Thay had littla usa for "grinds" who constantly 

studied hard to get top grades. 


1 

1 


2 

2 


3 

3 


4 

4 


5 

5 


(42) 

(43) 


144. They tended to look down on students who insisted 
on evaluating courses in terms of how well they 
prepared one for a job. 


1 


2 


3 


4 


5 


(44) 


145 . They frequently debated social and political 
problems far into the night. 


1 


2 


3 


4 


5 


(45) 


146. College was easier for me than for my friends. 


1 


2 


3 


4 


5 


(46) 


14/. Many of them had a strong desire to contribute to 
their field of study. 


1 


2 


3 


4 


5 


(47) 


148. Most of my friends had strong interests in 
science and mathematics. 


1 


2 


3 


4 


5 


(48) 


149. They were often caught up in the contagious 
enthusiasms of their teachers. 


1 


2 


3 


4 


5 


(49) 


150. We often had long, serious intellectual 
discussions . 


1 


2 


3 


4 


5 


(50) 


151. Few of them ever expected to become wealthy. 


1 


2 


3 


4 


5 


(51) 


152. There weren’t many opportunities for us to get 
together in extra-curricular activities. 


1 


2 


3 


4 


5 


(52) 


153. They often went to concerts and art exhibits when 
they were available . 


1 


2 


3 


4 


5 


(53) 


154. They attached little importance to how well they 
did relative to others in their courses. 


1 


2 


3 


4 


5 


(54) 


155. They were more concerned about taking interesting 
courses than courses directly useful in their 
vocations . 


1 


2 


3 


4 


5 


(55) 


156. Long, serious philosophical discussions were 
common among them. 


1 


2 


3 


4 


5 


(56) 


157. In comparing their abilities with mine I never 
felt particularly handicapped. 


1 


2 


3 


4 


5 


(57) 


158. They had little interest in pursuing careers 
involving research or scholarship. 


1 


2 


3 


4 


5 


(58) 


159. Few, if any, of them would like to engage in 
scientific research. 


1 


2 


3 


4 


5 


(59) 


160. They had strategies for helping each other to meet 
the faculty’s requirements with less work. 


1 


2 


3 


4 


5 


(60) 


161: They always enjoyed exploring ideas with each 
other . 


1 


2 


3 


4 


5 


(61) 
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Agree 



PART B — DESCRIPTIONS OF STUDENT ASSOCIATES 



Disagree 



162. They were accustomed to having plenty of money. 


1 


2 


3 


4 


5 


(62) 


163. We seldom went to movies, parties, etc., on the 
spur of the moment. 


1 


2 


3 


4 


5 


(63) 


164. They seemed to have little appreciation for the 
fine or applied arts. 


1 


2 


3 


4 


5 


(64) 


165 . Their grades indicated they were an unusually 
capable group relative to others in the 
college . 


1 


2 


3 


4 


5 


(65) 


166, Most of them believed that the main goal of a 
college education is to prepare the student 
for his vocational career. 


1 


2 


3 


4 


5 


(66) 


167. They never talked very much about ethical 
perplexities . 


1 


2 


3 


4 


5 


(67) 


168. The extremely high calibre of my student 
colleagues put a lot of pressure on me. 


1 


2 


3 


4 


5 


(68) 


169. I expect some of them to become eminent persons 
in their major fields of study. 


1 


2 


3 


4 


5 


(69) 


170. Most of them were planning careers in science. 


1 


2 


3 


4 


5 


(70) 


171. They sometimes ridiculed the faculty’s 

mannerisms and ideas with wild caricatures. 


1 


2 


3 


4 


5 


(71) 


172. They seemed to keep their intellectual concerns 
pretty much to themselves. 


1 


2 


3 


4 


5 


(72) 


173. They tended to evaluate future jobs in terms of 

their intrinsic interest and had little concern 
about whether they offered one a chance to earn 
a great deal of money. 


1 


2 


3 


4 


5 


(73) 



174. Everyone of us had a lot of fun in college. 


12 3 


4 5 (74) 





MEN: SKIP PART C BELOW, AND ANSWER QUESTION 189 AT THE END OF THIS QUESTIONNAIRE. 

WOMEN: PLEASE ANSWER ALL OF THE QUESTIONS IN PART G BELOW. 



PART C — ITEMS TO BE ANSWERED BY WOMEN ONLY 



INSTRUCTIONS : Statements in PART C are about your own attitudes and opinions, and those 
of the undergraduate women you knew best during the past year, £r about faculty members 
at your school. The object of description varies from item to item, but each stare- 
ment is worded so that the frame of reference of the question should be clear. 



DIRECTIONS : Please circle the number of the rating scale indicating the 

extent to which you believe the statement is true of the object of 
description (yourself, your women friends, or faculty members). 



175. Few, if any, of my close women friends planned to 

seek an advanced graduate or professional degree. 



Disagree Agree 

123 45 ( 7 ) 
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176. 



Agree 



PART C — ITEMS TO BE ANSWERED BY WOMEN ONLY | 



If I were to decide to seek advanced training, I 
am confident that I would be able to get a 
desirable job in my career field. 

177. It is easy for me to think of women who have made 

important contributions in my field of study. 

178. Most of my close female friends felt they had to 

play down their intelligence when on dates. 

179. Pursuing a career is more important to me than 

marriage . 



Disagree 
12 3 

12 3 

12 3 

12 3 



4 5 (8) 

4 5(9) 

4 5 (10) 

4 5 (11) 



180. Most of my close women friends felt they could not 

realize their full potentialities by "just 

being a housewife." 1 2 3 4 5 (12) 

181. In my opinion it is unlikely that a woman can make 

an outstanding contribution in my major field 

of study. 1 2 3 4 5 (13) 

182. Most of my female associates were determined to be 

themselves regardless of what their male 

companions expected . 12345(14) 



183. My teachers tended to assume that women are unlikely 
to be interested in advanced training. 



12 3 



4 5 (15) 



184. Most of my women friends believed that the goals of 
getting married and obtaining a graduate or 

professional degree are incompatible. 123 45 (16) 



185 . When dating men this year I never felt I had to 
play down my intelligence . 


1 


2 


3 


4 


5 


(17) 


186. Most of my close women friends enjoyed engaging in 
intellectual discussions on dates. 


1 


2 


3 


4 


5 


(18) 


187 . I do not believe it will be possible for me to 
combine marriage and a career. 


]. 


2 


3 


4 


5 


(19) 


188. There swere no women On the faculty of my school 
whom I admired. 


1 


2 


3 


4 


5 


(20) 



IMPORTANT 



You have now completed the questionnaire. Please fold it and return it in the enclosed, 
stamped envelope to Project E, Department of Psychology, Vanderbilt University, 
Nashville, Tennessee 37203. Your replies to this questionnaire are completely confi- 
dential, and absolutely no information of any kind about specific persons will be re- 
leased to your school or anyone else. Your questionnaire will be read only by the 
research staff working on this project. 

189. Do you wish to receive information about where you may find 

a report of the results of this project after the three- No . . . 0 

year study is completed? (Circle one.) Yes. . . 1 

(75) or (21) 






ERIC 
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